Max level shown:
12024-12-16T21:00:01.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 171faa0d-4ca1-4fbd-9ade-7ac7c3a283da roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
22024-12-16T21:00:01.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 171faa0d-4ca1-4fbd-9ade-7ac7c3a283da resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
32024-12-16T21:00:01.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 171faa0d-4ca1-4fbd-9ade-7ac7c3a283da response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
42024-12-16T21:00:02.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1303 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = b3b3a9a3-78bb-43e1-82f7-1602b904c215 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
52024-12-16T21:00:02.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b7cd7d18-e57d-44e4-99c9-31197e7ed15f roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
62024-12-16T21:00:02.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b7cd7d18-e57d-44e4-99c9-31197e7ed15f resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
72024-12-16T21:00:02.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b7cd7d18-e57d-44e4-99c9-31197e7ed15f response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
82024-12-16T21:00:04.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b7ba3dc7-cb3f-4a58-817e-e64678a3ae2a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
92024-12-16T21:00:04.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b7ba3dc7-cb3f-4a58-817e-e64678a3ae2a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
102024-12-16T21:00:04.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b7ba3dc7-cb3f-4a58-817e-e64678a3ae2a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
112024-12-16T21:00:05.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2da8eb20-e09a-45ae-b81c-98ecfee88e31 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
122024-12-16T21:00:05.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2da8eb20-e09a-45ae-b81c-98ecfee88e31 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
132024-12-16T21:00:05.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2da8eb20-e09a-45ae-b81c-98ecfee88e31 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
142024-12-16T21:00:05.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
152024-12-16T21:00:05.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-12-16T21:00:05.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-12-16T21:00:05.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
182024-12-16T21:00:05.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
192024-12-16T21:00:05.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
202024-12-16T21:00:05.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
212024-12-16T21:00:05.968ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
222024-12-16T21:00:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
232024-12-16T21:00:05.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.296082ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
242024-12-16T21:00:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
252024-12-16T21:00:05.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262024-12-16T21:00:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-12-16T21:00:05.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-12-16T21:00:05.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-12-16T21:00:05.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
302024-12-16T21:00:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
312024-12-16T21:00:05.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
322024-12-16T21:00:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
332024-12-16T21:00:05.985ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
342024-12-16T21:00:05.985ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.691368ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
352024-12-16T21:00:06.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 44ffad3b-e8fa-48e5-9476-74e96d2cba90 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
362024-12-16T21:00:06.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 44ffad3b-e8fa-48e5-9476-74e96d2cba90 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
372024-12-16T21:00:06.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 44ffad3b-e8fa-48e5-9476-74e96d2cba90 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
382024-12-16T21:00:07.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 54e50042-30b2-4ecc-879a-eb74b8713de1 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
392024-12-16T21:00:07.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 54e50042-30b2-4ecc-879a-eb74b8713de1 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
402024-12-16T21:00:07.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 54e50042-30b2-4ecc-879a-eb74b8713de1 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
412024-12-16T21:00:08.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 971a6346-a91b-4a89-a53e-b132a1fe3e29 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
422024-12-16T21:00:08.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 971a6346-a91b-4a89-a53e-b132a1fe3e29 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
432024-12-16T21:00:08.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 971a6346-a91b-4a89-a53e-b132a1fe3e29 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
442024-12-16T21:00:09.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 21850fc6-ba37-44ab-a61a-898ed86232f5 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
452024-12-16T21:00:09.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 21850fc6-ba37-44ab-a61a-898ed86232f5 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
462024-12-16T21:00:09.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 21850fc6-ba37-44ab-a61a-898ed86232f5 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
472024-12-16T21:00:10.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2a397067-3425-4935-ac41-68d383905e0d roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
482024-12-16T21:00:10.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2a397067-3425-4935-ac41-68d383905e0d resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
492024-12-16T21:00:10.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2a397067-3425-4935-ac41-68d383905e0d response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
502024-12-16T21:00:11.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 904ff6b7-5c17-4fde-91e9-3f79e4be51a6 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
512024-12-16T21:00:11.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 904ff6b7-5c17-4fde-91e9-3f79e4be51a6 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
522024-12-16T21:00:11.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 904ff6b7-5c17-4fde-91e9-3f79e4be51a6 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
532024-12-16T21:00:12.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 4616e892-9ca2-4773-acaf-cf7c59341a49 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
542024-12-16T21:00:12.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fc912c6e-93b3-4785-82ed-8df89fae0129 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
552024-12-16T21:00:12.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fc912c6e-93b3-4785-82ed-8df89fae0129 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
562024-12-16T21:00:12.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fc912c6e-93b3-4785-82ed-8df89fae0129 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
572024-12-16T21:00:13.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8dd6ab80-ed84-4786-a2f6-6de4f02cc222 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
582024-12-16T21:00:13.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8dd6ab80-ed84-4786-a2f6-6de4f02cc222 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
592024-12-16T21:00:13.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8dd6ab80-ed84-4786-a2f6-6de4f02cc222 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
602024-12-16T21:00:14.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 667634c2-89aa-4a30-9cb4-cfe6a6ea2177 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
612024-12-16T21:00:14.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 667634c2-89aa-4a30-9cb4-cfe6a6ea2177 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
622024-12-16T21:00:14.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 667634c2-89aa-4a30-9cb4-cfe6a6ea2177 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
632024-12-16T21:00:15.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 06a3548b-50c2-4d9f-935f-bd898c56fa5e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
642024-12-16T21:00:15.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 06a3548b-50c2-4d9f-935f-bd898c56fa5e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
652024-12-16T21:00:15.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 06a3548b-50c2-4d9f-935f-bd898c56fa5e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
662024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
672024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
682024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
692024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
702024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
712024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
722024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
732024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
742024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
752024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
762024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
772024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
782024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
792024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
802024-12-16T21:00:15.966ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-16 20:50:15.966742652 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
812024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
822024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
832024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
842024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
852024-12-16T21:00:15.966ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
862024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
872024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
882024-12-16T21:00:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
892024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
902024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
912024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
922024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
932024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
942024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
952024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
962024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
972024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
982024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
992024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
1002024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1012024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1022024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
1032024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1042024-12-16T21:00:15.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
1052024-12-16T21:00:15.968ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1062024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1072024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
1082024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
1092024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1102024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
1112024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1122024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
1132024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
1142024-12-16T21:00:15.968ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
1152024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
1162024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
1172024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1182024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
1192024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
1202024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1212024-12-16T21:00:15.968ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546
1222024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1232024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.44\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546"}
1242024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
1252024-12-16T21:00:15.968ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
1262024-12-16T21:00:15.968ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
1272024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
1282024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1292024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1302024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
1312024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1322024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
1332024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1342024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
1352024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1362024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
1372024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1382024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
1392024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
1402024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1412024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
1422024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1432024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1442024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
1452024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1462024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1472024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1482024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1492024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
1502024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1512024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1522024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1532024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1542024-12-16T21:00:15.968ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
1552024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1562024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1572024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1582024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1592024-12-16T21:00:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2bad804c-125d-4b4f-bbb4-08849c8bee33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e73705b-19c3-4191-883c-2bba82160d3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 498793623 } })
1602024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1612024-12-16T21:00:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2119cbc5-42cf-405b-af5a-3fb6ae08bc7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 498828674 } })
1622024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1632024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1642024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1652024-12-16T21:00:15.968ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1662024-12-16T21:00:15.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 991.959\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1672024-12-16T21:00:15.969ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
1682024-12-16T21:00:15.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.126091ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
1692024-12-16T21:00:15.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1702024-12-16T21:00:15.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-12-16T21:00:15.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1722024-12-16T21:00:15.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.799583ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1732024-12-16T21:00:15.971ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-16 20:50:15.966742652 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1742024-12-16T21:00:15.971ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.765221ms iteration = 11 status = {"expiration":"2024-12-16T20:50:15.966742652Z","pruned":[]}
1752024-12-16T21:00:15.971ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 502033945 } })
1762024-12-16T21:00:15.972ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1772024-12-16T21:00:15.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1782024-12-16T21:00:15.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1792024-12-16T21:00:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1802024-12-16T21:00:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1812024-12-16T21:00:15.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1822024-12-16T21:00:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1832024-12-16T21:00:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1842024-12-16T21:00:15.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1852024-12-16T21:00:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1862024-12-16T21:00:15.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1872024-12-16T21:00:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1882024-12-16T21:00:15.976ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 506585232 } })
1892024-12-16T21:00:15.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1902024-12-16T21:00:15.976ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1912024-12-16T21:00:15.977ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1922024-12-16T21:00:15.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-12-16T21:00:15.977ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1942024-12-16T21:00:15.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1952024-12-16T21:00:15.978ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1962024-12-16T21:00:15.978ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1972024-12-16T21:00:15.978ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.574852ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1982024-12-16T21:00:15.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1992024-12-16T21:00:15.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2002024-12-16T21:00:15.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2012024-12-16T21:00:15.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2022024-12-16T21:00:15.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2032024-12-16T21:00:15.980ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2042024-12-16T21:00:15.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2052024-12-16T21:00:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2062024-12-16T21:00:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2072024-12-16T21:00:15.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2082024-12-16T21:00:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2092024-12-16T21:00:15.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2102024-12-16T21:00:15.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2112024-12-16T21:00:15.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2122024-12-16T21:00:15.984ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2132024-12-16T21:00:15.984ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2142024-12-16T21:00:15.984ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2152024-12-16T21:00:15.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2162024-12-16T21:00:15.985ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.080637ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
2172024-12-16T21:00:15.985ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2182024-12-16T21:00:15.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2192024-12-16T21:00:15.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2202024-12-16T21:00:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2212024-12-16T21:00:15.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2222024-12-16T21:00:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2232024-12-16T21:00:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2242024-12-16T21:00:15.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2252024-12-16T21:00:15.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2262024-12-16T21:00:15.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2272024-12-16T21:00:15.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2282024-12-16T21:00:15.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2292024-12-16T21:00:15.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302024-12-16T21:00:15.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2312024-12-16T21:00:15.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-12-16T21:00:15.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2332024-12-16T21:00:15.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2342024-12-16T21:00:15.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2352024-12-16T21:00:15.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2362024-12-16T21:00:15.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2372024-12-16T21:00:15.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2382024-12-16T21:00:15.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2392024-12-16T21:00:15.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2402024-12-16T21:00:15.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2412024-12-16T21:00:15.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2422024-12-16T21:00:15.998ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 528888498 } })
2432024-12-16T21:00:15.999ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
2442024-12-16T21:00:16.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2452024-12-16T21:00:16.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
2462024-12-16T21:00:16.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2472024-12-16T21:00:16.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2482024-12-16T21:00:16.006ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492024-12-16T21:00:16.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502024-12-16T21:00:16.008ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
2512024-12-16T21:00:16.008ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
2522024-12-16T21:00:16.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
2532024-12-16T21:00:16.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2542024-12-16T21:00:16.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2552024-12-16T21:00:16.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2562024-12-16T21:00:16.014ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
2572024-12-16T21:00:16.014ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 48d576fa-5dfc-47e3-bc59-4b8fa679948b
2582024-12-16T21:00:16.014ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 87bacc64-1a57-404c-8a3f-ef7fa19c309c
2592024-12-16T21:00:16.014ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(794176e8-60f3-4f98-9c71-ea05fe28c667, 0), (1f4ffd24-7dc9-4bb2-8978-9e382eae9b9b, 0), (f610df22-eef4-4db0-bb20-5128859cbec0, 0), (adc16a3e-896b-4588-a503-8e3726b685f3, 0)] collection_id = 794176e8-60f3-4f98-9c71-ea05fe28c667
2602024-12-16T21:00:16.014ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
2612024-12-16T21:00:16.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
2622024-12-16T21:00:16.017ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 24e0ec24-fdab-4c62-b0db-4dad53543ae5
2632024-12-16T21:00:16.017ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 24e0ec24-fdab-4c62-b0db-4dad53543ae5
2642024-12-16T21:00:16.017ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 48d576fa-5dfc-47e3-bc59-4b8fa679948b
2652024-12-16T21:00:16.017ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 87bacc64-1a57-404c-8a3f-ef7fa19c309c
2662024-12-16T21:00:16.017ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 49.019436ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
2672024-12-16T21:00:16.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2682024-12-16T21:00:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2692024-12-16T21:00:16.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2702024-12-16T21:00:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2712024-12-16T21:00:16.024ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2722024-12-16T21:00:16.024ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2732024-12-16T21:00:16.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2742024-12-16T21:00:16.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2752024-12-16T21:00:16.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.156132ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2762024-12-16T21:00:16.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.013869ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
2772024-12-16T21:00:16.026ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2782024-12-16T21:00:16.026ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2792024-12-16T21:00:16.026ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 59.838794ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2802024-12-16T21:00:16.027ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2812024-12-16T21:00:16.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2822024-12-16T21:00:16.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2832024-12-16T21:00:16.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2842024-12-16T21:00:16.030ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2852024-12-16T21:00:16.030ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2862024-12-16T21:00:16.030ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2872024-12-16T21:00:16.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2882024-12-16T21:00:16.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-12-16T21:00:16.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2902024-12-16T21:00:16.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2912024-12-16T21:00:16.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2922024-12-16T21:00:16.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 67.590161ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2932024-12-16T21:00:16.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.851287ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
2942024-12-16T21:00:16.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2952024-12-16T21:00:16.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2962024-12-16T21:00:16.036ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
2972024-12-16T21:00:16.036ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.268283ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
2982024-12-16T21:00:16.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2992024-12-16T21:00:16.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3002024-12-16T21:00:16.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3012024-12-16T21:00:16.041ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3022024-12-16T21:00:16.041ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3032024-12-16T21:00:16.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3042024-12-16T21:00:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3052024-12-16T21:00:16.046ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3062024-12-16T21:00:16.046ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.532221ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3072024-12-16T21:00:16.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082024-12-16T21:00:16.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3092024-12-16T21:00:16.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3102024-12-16T21:00:16.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3112024-12-16T21:00:16.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3122024-12-16T21:00:16.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3132024-12-16T21:00:16.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3142024-12-16T21:00:16.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3152024-12-16T21:00:16.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3162024-12-16T21:00:16.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3172024-12-16T21:00:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3182024-12-16T21:00:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3192024-12-16T21:00:16.071ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 794176e8-60f3-4f98-9c71-ea05fe28c667 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
3202024-12-16T21:00:16.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3212024-12-16T21:00:16.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3222024-12-16T21:00:16.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3232024-12-16T21:00:16.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3242024-12-16T21:00:16.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3252024-12-16T21:00:16.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3262024-12-16T21:00:16.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.729656ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3272024-12-16T21:00:16.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-12-16T21:00:16.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3292024-12-16T21:00:16.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3302024-12-16T21:00:16.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3312024-12-16T21:00:16.084ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3322024-12-16T21:00:16.084ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3332024-12-16T21:00:16.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3342024-12-16T21:00:16.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3352024-12-16T21:00:16.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3362024-12-16T21:00:16.085ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3372024-12-16T21:00:16.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3382024-12-16T21:00:16.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.30794ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3392024-12-16T21:00:16.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3402024-12-16T21:00:16.086ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3412024-12-16T21:00:16.086ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3422024-12-16T21:00:16.086ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.578316ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3432024-12-16T21:00:16.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3442024-12-16T21:00:16.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3452024-12-16T21:00:16.088ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3462024-12-16T21:00:16.088ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3472024-12-16T21:00:16.088ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3482024-12-16T21:00:16.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3492024-12-16T21:00:16.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3502024-12-16T21:00:16.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-12-16T21:00:16.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3522024-12-16T21:00:16.089ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(1f4ffd24-7dc9-4bb2-8978-9e382eae9b9b, 0), (f610df22-eef4-4db0-bb20-5128859cbec0, 0), (adc16a3e-896b-4588-a503-8e3726b685f3, 0)]
3532024-12-16T21:00:16.090ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 620591691 } })
3542024-12-16T21:00:16.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
3552024-12-16T21:00:16.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3562024-12-16T21:00:16.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3572024-12-16T21:00:16.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3582024-12-16T21:00:16.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3592024-12-16T21:00:16.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3602024-12-16T21:00:16.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3612024-12-16T21:00:16.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3622024-12-16T21:00:16.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3632024-12-16T21:00:16.095ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.104187ms iteration = 21 status = 0
3642024-12-16T21:00:16.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3652024-12-16T21:00:16.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3662024-12-16T21:00:16.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3672024-12-16T21:00:16.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3682024-12-16T21:00:16.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3692024-12-16T21:00:16.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3702024-12-16T21:00:16.101ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3712024-12-16T21:00:16.101ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3722024-12-16T21:00:16.101ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dde404d7-2610-4012-b5a9-6e94e666a9c3", "content-length": "26", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
3732024-12-16T21:00:16.101ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3742024-12-16T21:00:16.102ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3752024-12-16T21:00:16.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3762024-12-16T21:00:16.103ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3772024-12-16T21:00:16.113ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-16T20:50:11.628239Z, time_modified: 2024-12-16T20:50:11.628239Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }) }
3782024-12-16T21:00:16.113ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.598231ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]}},"default_endpoint":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3792024-12-16T21:00:16.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-12-16T21:00:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3812024-12-16T21:00:16.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3822024-12-16T21:00:16.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3832024-12-16T21:00:16.122ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3842024-12-16T21:00:16.122ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3852024-12-16T21:00:16.122ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-16 20:50:36.066577 UTC dns_group = internal generation = 1
3862024-12-16T21:00:16.122ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.156864ms iteration = 12 status = {"generation":1}
3872024-12-16T21:00:16.130ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3882024-12-16T21:00:16.130ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 0 version = 2
3892024-12-16T21:00:16.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3902024-12-16T21:00:16.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3912024-12-16T21:00:16.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3922024-12-16T21:00:16.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3932024-12-16T21:00:16.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3942024-12-16T21:00:16.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3952024-12-16T21:00:16.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3962024-12-16T21:00:16.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3972024-12-16T21:00:16.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
3982024-12-16T21:00:16.147ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3992024-12-16T21:00:16.147ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1eb60c28-9894-4953-ad39-a7d55f8090a4", "content-length": "26", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4002024-12-16T21:00:16.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4012024-12-16T21:00:16.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
4022024-12-16T21:00:16.159ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4032024-12-16T21:00:16.159ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 191.664032ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4042024-12-16T21:00:16.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4052024-12-16T21:00:16.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4062024-12-16T21:00:16.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4072024-12-16T21:00:16.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4082024-12-16T21:00:16.163ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.023585ms iteration = 24 status = {"physical_disks_added":0}
4092024-12-16T21:00:16.216ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4102024-12-16T21:00:16.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d83d51b8-c460-445e-af29-06fb4c554781 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
4112024-12-16T21:00:16.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d83d51b8-c460-445e-af29-06fb4c554781 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
4122024-12-16T21:00:16.315ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.205382ms iteration = 21 status = {}
4132024-12-16T21:00:16.317ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
4142024-12-16T21:00:16.317ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4152024-12-16T21:00:16.317ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ff74060-fd5b-4f6d-a52f-c5f4bffea7ec", "content-length": "26", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4162024-12-16T21:00:16.317ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4172024-12-16T21:00:16.319ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4182024-12-16T21:00:16.470ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4192024-12-16T21:00:16.498ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4202024-12-16T21:00:16.499ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d106dd0e-7d41-466b-8ae1-5cb9392402bf", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4212024-12-16T21:00:16.499ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4222024-12-16T21:00:16.504ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "42a456e6-3866-47a8-ae9c-b1b2c83d58b3", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4232024-12-16T21:00:16.504ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4242024-12-16T21:00:16.506ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4252024-12-16T21:00:16.506ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 539.404866ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4262024-12-16T21:00:16.521ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4272024-12-16T21:00:16.521ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a22ff28-2763-4fee-90f4-9009e6eef6e1", "content-length": "1", "date": "Mon, 16 Dec 2024 21:00:15 GMT"} })
4282024-12-16T21:00:16.523ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4292024-12-16T21:00:16.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4302024-12-16T21:00:16.528ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
4312024-12-16T21:00:16.528ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
4322024-12-16T21:00:16.528ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
4332024-12-16T21:00:16.529ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b71f9dc-6005-4d6f-a45b-84bef7e6aeaf", "content-length": "476", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4342024-12-16T21:00:16.529ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
4352024-12-16T21:00:16.529ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e2e98d8-e212-4b35-839d-cd6e06fac1df", "content-length": "734", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4362024-12-16T21:00:16.529ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
4372024-12-16T21:00:16.529ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a866ca89-0c75-489b-bda8-25c875b0c21d", "content-length": "111", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4382024-12-16T21:00:16.529ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
4392024-12-16T21:00:16.530ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "71de84fb-95f9-439b-bd1b-4b9463bb7a7f", "content-length": "111", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4402024-12-16T21:00:16.530ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
4412024-12-16T21:00:16.530ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f241bf3-d688-4ca7-bb81-07c8eb5354fa", "content-length": "167", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4422024-12-16T21:00:16.530ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
4432024-12-16T21:00:16.530ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "da36b374-e98f-4866-b0de-2e27e6d8d7c7", "content-length": "167", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4442024-12-16T21:00:16.530ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
4452024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb78863e-8a31-4cf6-b094-6b83b5aaabb4", "content-length": "175", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4462024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
4472024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "266cef0a-dcd6-4660-950f-1f2951b1137e", "content-length": "175", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4482024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
4492024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "272c476b-6c1a-4a26-958e-1456941220f3", "content-length": "702", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4502024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
4512024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "597e7197-d6ea-4c33-94b1-267dc2057fac", "content-length": "727", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4522024-12-16T21:00:16.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
4532024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5f777e5-e70a-457e-959f-882556924aeb", "content-length": "729", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4542024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
4552024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a9cdc7-1370-42f7-bb6f-4cb07b617760", "content-length": "728", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4562024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
4572024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "215edafb-85e7-4aa5-b1e6-b68662e3348c", "content-length": "722", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4582024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
4592024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "533d0d39-f144-43bd-866d-1451cc66601a", "content-length": "109", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4602024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
4612024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "94555f75-38b9-4177-99c5-6c8982075310", "content-length": "109", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4622024-12-16T21:00:16.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
4632024-12-16T21:00:16.533ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4642024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4652024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b81eb82-2ad0-40fd-9cb6-f0b40bcf3800", "content-length": "169", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4662024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
4672024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "51d5fbc5-41e1-4fc9-a792-70f5a4da3c13", "content-length": "169", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4682024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
4692024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3c76ee-2d21-4e20-a909-1c099291b958", "content-length": "372", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4702024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4712024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "72d34a05-93f9-4f34-bf8f-c7445e514520", "content-length": "178", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4722024-12-16T21:00:16.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
4732024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4742024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0f38084-09e7-4ce4-873c-743e7c14c9c3", "content-length": "178", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4752024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
4762024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa53e76e-73a8-41e1-8555-cbc75e28daf4", "content-length": "702", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4772024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4782024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "651704a8-2e0e-452e-a78a-d3ef7d85dd50", "content-length": "727", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4792024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4802024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dcd6e2b-7f0d-44a0-85ca-d97fd1be14b3", "content-length": "729", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4812024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4822024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e85c5850-fa67-4054-af1b-e35106d6ccf7", "content-length": "728", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
4832024-12-16T21:00:16.534ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4842024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4852024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4862024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4872024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 1 version = 2
4882024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4892024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-16 20:50:36.849175 UTC dns_group = external generation = 2
4902024-12-16T21:00:16.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 567.916821ms iteration = 12 status = {"generation":2}
4912024-12-16T21:00:16.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d83d51b8-c460-445e-af29-06fb4c554781 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
4922024-12-16T21:00:16.537ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 570.658333ms iteration = 21 status = null
4932024-12-16T21:00:16.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4942024-12-16T21:00:16.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4952024-12-16T21:00:16.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4962024-12-16T21:00:16.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4972024-12-16T21:00:16.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4982024-12-16T21:00:16.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4992024-12-16T21:00:16.540ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002024-12-16T21:00:16.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012024-12-16T21:00:16.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5022024-12-16T21:00:16.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5032024-12-16T21:00:16.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5042024-12-16T21:00:16.543ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5052024-12-16T21:00:16.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5062024-12-16T21:00:16.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5072024-12-16T21:00:16.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5082024-12-16T21:00:16.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5092024-12-16T21:00:16.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5102024-12-16T21:00:16.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5112024-12-16T21:00:16.545ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5122024-12-16T21:00:16.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5132024-12-16T21:00:16.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5142024-12-16T21:00:16.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5152024-12-16T21:00:16.547ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5162024-12-16T21:00:16.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5172024-12-16T21:00:16.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5182024-12-16T21:00:16.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5192024-12-16T21:00:16.550ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5202024-12-16T21:00:16.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5212024-12-16T21:00:16.555ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
5222024-12-16T21:00:16.555ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
5232024-12-16T21:00:16.555ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "64b3491f-5f25-48a2-aa21-b0be0cf34afd", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
5242024-12-16T21:00:16.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5252024-12-16T21:00:16.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5262024-12-16T21:00:16.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
5272024-12-16T21:00:16.588ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "873ec5ee-62e3-4690-9a72-f4647fd1ad84", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5282024-12-16T21:00:16.588ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5292024-12-16T21:00:16.590ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7476a5d5-7117-4fad-9829-87480cd9ae05", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5302024-12-16T21:00:16.590ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5312024-12-16T21:00:16.592ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "70fb64c0-49e6-4c6b-8331-b3e3e43f8a58", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5322024-12-16T21:00:16.592ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5332024-12-16T21:00:16.594ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
5342024-12-16T21:00:16.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 627.51421ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
5352024-12-16T21:00:16.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5362024-12-16T21:00:16.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372024-12-16T21:00:16.627ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5382024-12-16T21:00:16.627ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "366ba17b-8c63-4cc1-85ef-30e6fdcd6ae5", "content-length": "691", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
5392024-12-16T21:00:16.627ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
5402024-12-16T21:00:16.627ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
5412024-12-16T21:00:16.627ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5422024-12-16T21:00:16.627ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
5432024-12-16T21:00:16.627ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
5442024-12-16T21:00:16.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5452024-12-16T21:00:16.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5462024-12-16T21:00:16.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5472024-12-16T21:00:16.629ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 661.690963ms iteration = 21 status = {}
5482024-12-16T21:00:16.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5492024-12-16T21:00:16.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-12-16T21:00:16.630ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
5512024-12-16T21:00:16.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5522024-12-16T21:00:16.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5532024-12-16T21:00:16.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5542024-12-16T21:00:16.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5552024-12-16T21:00:16.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5562024-12-16T21:00:16.634ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5572024-12-16T21:00:16.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5582024-12-16T21:00:16.635ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5592024-12-16T21:00:16.635ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5602024-12-16T21:00:16.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5612024-12-16T21:00:16.636ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "04e78c56-86e3-4dea-86d9-f5eb3f2527b3", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
5622024-12-16T21:00:16.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5632024-12-16T21:00:16.638ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 670.188685ms iteration = 22 status = {}
5642024-12-16T21:00:16.638ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5652024-12-16T21:00:16.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5662024-12-16T21:00:16.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-12-16T21:00:16.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5682024-12-16T21:00:16.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "79c8c1da-22b8-4538-b084-7e2a8da6e7a1", "content-length": "134", "date": "Mon, 16 Dec 2024 21:00:15 GMT"} })
5692024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
5702024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
5712024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5722024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5732024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5742024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5752024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5762024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5772024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5782024-12-16T21:00:16.641ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5792024-12-16T21:00:16.642ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
5802024-12-16T21:00:16.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5812024-12-16T21:00:16.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5822024-12-16T21:00:16.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5832024-12-16T21:00:16.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5842024-12-16T21:00:16.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5852024-12-16T21:00:16.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5862024-12-16T21:00:16.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8d7c286-d771-45d4-b4e7-a06bbfecfc84", "content-length": "2", "date": "Mon, 16 Dec 2024 21:00:15 GMT"} })
5872024-12-16T21:00:16.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5882024-12-16T21:00:16.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ea4f89c-5779-4bc5-9924-314f1862c990", "content-length": "52", "date": "Mon, 16 Dec 2024 21:00:15 GMT"} })
5892024-12-16T21:00:16.644ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
5902024-12-16T21:00:16.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5912024-12-16T21:00:16.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5922024-12-16T21:00:16.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5932024-12-16T21:00:16.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5942024-12-16T21:00:16.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5952024-12-16T21:00:16.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5962024-12-16T21:00:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5972024-12-16T21:00:16.653ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5982024-12-16T21:00:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5992024-12-16T21:00:16.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6002024-12-16T21:00:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012024-12-16T21:00:16.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6022024-12-16T21:00:16.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6032024-12-16T21:00:16.659ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6042024-12-16T21:00:16.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6052024-12-16T21:00:16.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062024-12-16T21:00:16.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6072024-12-16T21:00:16.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6082024-12-16T21:00:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6092024-12-16T21:00:16.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6102024-12-16T21:00:16.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6112024-12-16T21:00:16.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6122024-12-16T21:00:16.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6132024-12-16T21:00:16.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-12-16T21:00:16.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6152024-12-16T21:00:16.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6162024-12-16T21:00:16.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6172024-12-16T21:00:16.680ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 385afd3c-c4bc-466d-aded-671dcaae558c, kind: Service { id: 2119cbc5-42cf-405b-af5a-3fb6ae08bc7a }, name: Name("external-dns-2119cbc5-42cf-405b-af5a-3fb6ae08bc7a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 204])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d8db14d2-7328-40e7-9590-6eb751d3a838, kind: Service { id: 2185e6c6-5b12-4687-9851-21db46e777e2 }, name: Name("external-dns-2185e6c6-5b12-4687-9851-21db46e777e2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 70])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 3e02eed7-ed50-4fa9-9995-0d06bf2c3948, kind: Service { id: 9b7eeb1f-970c-4a87-917a-4bd5410695ea }, name: Name("nexus-9b7eeb1f-970c-4a87-917a-4bd5410695ea"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 592edc29-2598-47a0-a7bb-649dee5ed385, kind: Service { id: 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4 }, name: Name("nexus-4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ecc162e-b2e1-499f-87ac-6d15260061c6, kind: Service { id: f3059a9f-5671-4082-84f5-29130f4288b6 }, name: Name("nexus-f3059a9f-5671-4082-84f5-29130f4288b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 16])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
6182024-12-16T21:00:16.680ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6192024-12-16T21:00:16.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6202024-12-16T21:00:16.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6212024-12-16T21:00:16.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
6222024-12-16T21:00:16.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6232024-12-16T21:00:16.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6242024-12-16T21:00:16.685ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
6252024-12-16T21:00:16.685ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 385afd3c-c4bc-466d-aded-671dcaae558c, kind: Service { id: 2119cbc5-42cf-405b-af5a-3fb6ae08bc7a }, name: Name("external-dns-2119cbc5-42cf-405b-af5a-3fb6ae08bc7a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 204])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d8db14d2-7328-40e7-9590-6eb751d3a838, kind: Service { id: 2185e6c6-5b12-4687-9851-21db46e777e2 }, name: Name("external-dns-2185e6c6-5b12-4687-9851-21db46e777e2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 70])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3e02eed7-ed50-4fa9-9995-0d06bf2c3948, kind: Service { id: 9b7eeb1f-970c-4a87-917a-4bd5410695ea }, name: Name("nexus-9b7eeb1f-970c-4a87-917a-4bd5410695ea"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 592edc29-2598-47a0-a7bb-649dee5ed385, kind: Service { id: 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4 }, name: Name("nexus-4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ecc162e-b2e1-499f-87ac-6d15260061c6, kind: Service { id: f3059a9f-5671-4082-84f5-29130f4288b6 }, name: Name("nexus-f3059a9f-5671-4082-84f5-29130f4288b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 16])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
6262024-12-16T21:00:16.685ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
6272024-12-16T21:00:16.750ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: fcb8d596-df56-4771-9db0-b88ea87e1f94, time_created: 2024-12-16T20:50:35.408225Z, time_modified: 2024-12-16T20:50:35.408225Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
6282024-12-16T21:00:16.750ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
6292024-12-16T21:00:16.750ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6302024-12-16T21:00:16.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6312024-12-16T21:00:16.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6322024-12-16T21:00:16.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6332024-12-16T21:00:16.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342024-12-16T21:00:16.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
6352024-12-16T21:00:16.768ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3a1a88d8-d8a9-4b18-8664-d8eab7374e6e", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
6362024-12-16T21:00:16.768ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
6372024-12-16T21:00:16.768ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
6382024-12-16T21:00:16.768ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b243a141-b3a4-4305-9684-6b4e7f05150b", "content-length": "682", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
6392024-12-16T21:00:16.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6402024-12-16T21:00:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6412024-12-16T21:00:16.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6422024-12-16T21:00:16.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6432024-12-16T21:00:16.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6442024-12-16T21:00:16.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6452024-12-16T21:00:16.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6462024-12-16T21:00:16.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6472024-12-16T21:00:16.786ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 818.302685ms iteration = 21 status = {}
6482024-12-16T21:00:16.790ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
6492024-12-16T21:00:16.794ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f309ca41-f8d8-4326-b015-8cb4fa0ed025", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
6502024-12-16T21:00:16.795ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
6512024-12-16T21:00:16.795ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 827.892538ms
6522024-12-16T21:00:16.795ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 827.901819ms iteration = 3 status = {}
6532024-12-16T21:00:16.927ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6663305f-cc11-42d3-a768-574d50a41d89", "content-length": "30799", "date": "Mon, 16 Dec 2024 21:00:16 GMT"} })
6542024-12-16T21:00:16.929ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
6552024-12-16T21:00:16.929ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
6562024-12-16T21:00:16.929ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
6572024-12-16T21:00:16.930ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6582024-12-16T21:00:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6592024-12-16T21:00:16.932ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602024-12-16T21:00:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
6612024-12-16T21:00:16.934ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6622024-12-16T21:00:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6632024-12-16T21:00:17.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = f4afcc58-41d2-42dc-a155-bee87e3a55f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
6642024-12-16T21:00:17.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = f4afcc58-41d2-42dc-a155-bee87e3a55f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
6652024-12-16T21:00:17.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = f4afcc58-41d2-42dc-a155-bee87e3a55f9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
6662024-12-16T21:00:17.119ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d68bf513-9255-4506-bdef-ea529018d2ed file = nexus/db-queries/src/db/datastore/inventory.rs:1010
6672024-12-16T21:00:17.119ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d68bf513-9255-4506-bdef-ea529018d2ed time_started = 2024-12-16 21:00:16.528639 UTC
6682024-12-16T21:00:17.119ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.152747415s iteration = 4 status = {"collection_id":"d68bf513-9255-4506-bdef-ea529018d2ed","time_done":"2024-12-16 21:00:16.929304 UTC","time_started":"2024-12-16 21:00:16.528639 UTC"}
6692024-12-16T21:00:17.119ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
6702024-12-16T21:00:17.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6712024-12-16T21:00:17.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6722024-12-16T21:00:17.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732024-12-16T21:00:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6742024-12-16T21:00:17.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6752024-12-16T21:00:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6762024-12-16T21:00:17.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6772024-12-16T21:00:17.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6782024-12-16T21:00:17.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792024-12-16T21:00:17.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6802024-12-16T21:00:17.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6812024-12-16T21:00:17.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6822024-12-16T21:00:17.139ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.766427ms iteration = 25 status = {"physical_disks_added":0}
6832024-12-16T21:00:17.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9ede9a12-8fbc-4d6f-8aa9-d2ed49e7cea0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6842024-12-16T21:00:17.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9ede9a12-8fbc-4d6f-8aa9-d2ed49e7cea0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6852024-12-16T21:00:17.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9ede9a12-8fbc-4d6f-8aa9-d2ed49e7cea0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6862024-12-16T21:00:18.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 04ed51de-b6fd-46b7-b1a2-9a2d10f48b01 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6872024-12-16T21:00:18.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 04ed51de-b6fd-46b7-b1a2-9a2d10f48b01 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6882024-12-16T21:00:18.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 04ed51de-b6fd-46b7-b1a2-9a2d10f48b01 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6892024-12-16T21:00:19.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc502952-76fe-4b2f-81e4-2c24723c1fb1 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6902024-12-16T21:00:19.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc502952-76fe-4b2f-81e4-2c24723c1fb1 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6912024-12-16T21:00:19.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc502952-76fe-4b2f-81e4-2c24723c1fb1 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6922024-12-16T21:00:20.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b9bfd778-1970-4fc2-a491-d27ce817ccc2 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6932024-12-16T21:00:20.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b9bfd778-1970-4fc2-a491-d27ce817ccc2 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6942024-12-16T21:00:20.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b9bfd778-1970-4fc2-a491-d27ce817ccc2 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6952024-12-16T21:00:21.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0983ccf9-7506-49e9-b8b8-170452fe3d79 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6962024-12-16T21:00:21.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0983ccf9-7506-49e9-b8b8-170452fe3d79 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6972024-12-16T21:00:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0983ccf9-7506-49e9-b8b8-170452fe3d79 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
6982024-12-16T21:00:22.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1320 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 917f4f69-c377-4efd-bdee-e7a964109437 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
6992024-12-16T21:00:22.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 57bc5934-e4e6-43a8-98b1-be8242677c90 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7002024-12-16T21:00:22.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 57bc5934-e4e6-43a8-98b1-be8242677c90 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7012024-12-16T21:00:22.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 57bc5934-e4e6-43a8-98b1-be8242677c90 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7022024-12-16T21:00:23.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d179dfef-b8b7-4a0d-a322-ddf4887812e5 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7032024-12-16T21:00:23.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d179dfef-b8b7-4a0d-a322-ddf4887812e5 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7042024-12-16T21:00:23.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d179dfef-b8b7-4a0d-a322-ddf4887812e5 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7052024-12-16T21:00:24.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 177175be-e1d7-4f38-9dfc-1f259187f33d roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7062024-12-16T21:00:24.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 177175be-e1d7-4f38-9dfc-1f259187f33d resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7072024-12-16T21:00:24.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 177175be-e1d7-4f38-9dfc-1f259187f33d response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7082024-12-16T21:00:25.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dfa469d6-0d40-4f59-ae7a-89ef5e9e1c7b roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7092024-12-16T21:00:25.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dfa469d6-0d40-4f59-ae7a-89ef5e9e1c7b resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7102024-12-16T21:00:25.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dfa469d6-0d40-4f59-ae7a-89ef5e9e1c7b response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7112024-12-16T21:00:25.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
7122024-12-16T21:00:25.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7132024-12-16T21:00:25.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7142024-12-16T21:00:25.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
7152024-12-16T21:00:25.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7162024-12-16T21:00:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7172024-12-16T21:00:25.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-12-16T21:00:25.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7192024-12-16T21:00:25.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7202024-12-16T21:00:25.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7212024-12-16T21:00:25.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7222024-12-16T21:00:25.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7232024-12-16T21:00:25.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.226371ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7242024-12-16T21:00:25.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7252024-12-16T21:00:25.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7262024-12-16T21:00:25.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7272024-12-16T21:00:25.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
7282024-12-16T21:00:25.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7292024-12-16T21:00:25.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7302024-12-16T21:00:25.986ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
7312024-12-16T21:00:25.986ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.830149ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
7322024-12-16T21:00:26.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 47e905e2-fc4b-48ea-8eb7-465803f439b7 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7332024-12-16T21:00:26.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 47e905e2-fc4b-48ea-8eb7-465803f439b7 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7342024-12-16T21:00:26.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 47e905e2-fc4b-48ea-8eb7-465803f439b7 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7352024-12-16T21:00:27.646ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50082
7362024-12-16T21:00:27.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50082 req_id = e7fec237-6089-4def-9a04-ddb95012e312 roles = RoleSet { roles: {} } uri = /metrics/producers
7372024-12-16T21:00:27.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50082 req_id = e7fec237-6089-4def-9a04-ddb95012e312 resource = Database result = Ok(()) uri = /metrics/producers
7382024-12-16T21:00:27.684ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = ede88c21-b3b8-44c9-a8b3-4e80aa518dc6
7392024-12-16T21:00:27.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38504 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50082 req_id = e7fec237-6089-4def-9a04-ddb95012e312 response_code = 201 uri = /metrics/producers
7402024-12-16T21:00:27.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b486d86-ec11-4daf-8786-121a83c16436 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7412024-12-16T21:00:27.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b486d86-ec11-4daf-8786-121a83c16436 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7422024-12-16T21:00:27.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b486d86-ec11-4daf-8786-121a83c16436 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7432024-12-16T21:00:28.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0712f419-93ff-4ee7-80bc-b23fd8eec13f roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7442024-12-16T21:00:28.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0712f419-93ff-4ee7-80bc-b23fd8eec13f resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7452024-12-16T21:00:28.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0712f419-93ff-4ee7-80bc-b23fd8eec13f response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7462024-12-16T21:00:29.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3a47a6a3-742a-470b-8b2e-eb4e7bd75a4a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7472024-12-16T21:00:29.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3a47a6a3-742a-470b-8b2e-eb4e7bd75a4a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7482024-12-16T21:00:29.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3a47a6a3-742a-470b-8b2e-eb4e7bd75a4a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7492024-12-16T21:00:30.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 552a8db3-333e-407d-a9db-755d9ad85752 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7502024-12-16T21:00:30.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 552a8db3-333e-407d-a9db-755d9ad85752 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7512024-12-16T21:00:30.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 552a8db3-333e-407d-a9db-755d9ad85752 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7522024-12-16T21:00:31.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c5a11041-b6be-4b48-8965-1b3df706a25a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7532024-12-16T21:00:31.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c5a11041-b6be-4b48-8965-1b3df706a25a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7542024-12-16T21:00:31.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c5a11041-b6be-4b48-8965-1b3df706a25a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7552024-12-16T21:00:32.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1469 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 7ef50b65-03e9-45f9-bc48-6162e5f5c8e4 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
7562024-12-16T21:00:32.521ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59352
7572024-12-16T21:00:32.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59352 req_id = f6c14c98-8d0b-45e9-adba-1c9e9cbfc9bd roles = RoleSet { roles: {} } uri = /metrics/producers
7582024-12-16T21:00:32.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59352 req_id = f6c14c98-8d0b-45e9-adba-1c9e9cbfc9bd resource = Database result = Ok(()) uri = /metrics/producers
7592024-12-16T21:00:32.557ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 1222b2a4-5a9b-4afb-9176-bbb6ce6e62c8
7602024-12-16T21:00:32.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36084 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59352 req_id = f6c14c98-8d0b-45e9-adba-1c9e9cbfc9bd response_code = 201 uri = /metrics/producers
7612024-12-16T21:00:32.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc2faf3c-1cb2-4b8b-bdc8-3c16817a63e4 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7622024-12-16T21:00:32.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc2faf3c-1cb2-4b8b-bdc8-3c16817a63e4 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7632024-12-16T21:00:32.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc2faf3c-1cb2-4b8b-bdc8-3c16817a63e4 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7642024-12-16T21:00:33.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = abedc896-bf68-41f2-a691-3802ecf32499 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7652024-12-16T21:00:33.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = abedc896-bf68-41f2-a691-3802ecf32499 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7662024-12-16T21:00:33.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = abedc896-bf68-41f2-a691-3802ecf32499 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7672024-12-16T21:00:34.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a6d0c7c0-6bef-4534-a805-bb0a2fe91218 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7682024-12-16T21:00:34.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a6d0c7c0-6bef-4534-a805-bb0a2fe91218 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7692024-12-16T21:00:34.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a6d0c7c0-6bef-4534-a805-bb0a2fe91218 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7702024-12-16T21:00:35.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e78b46ac-89da-42b0-a8b7-0371f4332044 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7712024-12-16T21:00:35.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e78b46ac-89da-42b0-a8b7-0371f4332044 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7722024-12-16T21:00:35.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e78b46ac-89da-42b0-a8b7-0371f4332044 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7732024-12-16T21:00:35.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
7742024-12-16T21:00:35.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7752024-12-16T21:00:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7762024-12-16T21:00:35.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
7772024-12-16T21:00:35.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7782024-12-16T21:00:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7792024-12-16T21:00:35.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802024-12-16T21:00:35.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7812024-12-16T21:00:35.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7822024-12-16T21:00:35.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.19569ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7832024-12-16T21:00:35.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7842024-12-16T21:00:35.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7852024-12-16T21:00:35.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7862024-12-16T21:00:35.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7872024-12-16T21:00:35.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7882024-12-16T21:00:35.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892024-12-16T21:00:35.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
7902024-12-16T21:00:35.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7912024-12-16T21:00:35.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7922024-12-16T21:00:35.993ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
7932024-12-16T21:00:35.993ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.66791ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
7942024-12-16T21:00:36.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bb2498e6-f6cf-402a-ab54-016b21cca2e8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7952024-12-16T21:00:36.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bb2498e6-f6cf-402a-ab54-016b21cca2e8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7962024-12-16T21:00:36.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bb2498e6-f6cf-402a-ab54-016b21cca2e8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
7972024-12-16T21:00:37.852ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
7982024-12-16T21:00:37.852ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
7992024-12-16T21:00:37.883ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
8002024-12-16T21:00:37.883ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:38330
8012024-12-16T21:00:37.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38330 req_id = 2e36f121-8b8a-4d2c-ba76-b026023013d2 roles = RoleSet { roles: {} } uri = /metrics/producers
8022024-12-16T21:00:37.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38330 req_id = 2e36f121-8b8a-4d2c-ba76-b026023013d2 resource = Database result = Ok(()) uri = /metrics/producers
8032024-12-16T21:00:37.920ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
8042024-12-16T21:00:37.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36857 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38330 req_id = 2e36f121-8b8a-4d2c-ba76-b026023013d2 response_code = 201 uri = /metrics/producers
8052024-12-16T21:00:37.920ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2e36f121-8b8a-4d2c-ba76-b026023013d2", "content-length": "41", "date": "Mon, 16 Dec 2024 21:00:36 GMT"} })
8062024-12-16T21:00:37.921ZDEBGnexus (producer-registration-task): registered with nexus successfully
8072024-12-16T21:00:37.921ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
8082024-12-16T21:00:38.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 860a9e13-f146-49f5-9c97-89f1211685fb roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8092024-12-16T21:00:38.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 860a9e13-f146-49f5-9c97-89f1211685fb resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8102024-12-16T21:00:38.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 860a9e13-f146-49f5-9c97-89f1211685fb response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8112024-12-16T21:00:38.759ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43666
8122024-12-16T21:00:38.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43666 req_id = 0fbdea9e-c431-4842-b590-174adf65b40a roles = RoleSet { roles: {} } uri = /metrics/producers
8132024-12-16T21:00:38.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43666 req_id = 0fbdea9e-c431-4842-b590-174adf65b40a resource = Database result = Ok(()) uri = /metrics/producers
8142024-12-16T21:00:38.769ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 6202951a-b367-4347-b9c3-86c8b6bc919a
8152024-12-16T21:00:38.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9661 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43666 req_id = 0fbdea9e-c431-4842-b590-174adf65b40a response_code = 201 uri = /metrics/producers
8162024-12-16T21:00:39.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3e16e90b-b364-4ce3-8e23-76bcf885d164 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8172024-12-16T21:00:39.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3e16e90b-b364-4ce3-8e23-76bcf885d164 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8182024-12-16T21:00:39.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3e16e90b-b364-4ce3-8e23-76bcf885d164 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8192024-12-16T21:00:40.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac6fccb2-e790-4a92-83de-a69a31817e0e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8202024-12-16T21:00:40.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac6fccb2-e790-4a92-83de-a69a31817e0e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8212024-12-16T21:00:40.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac6fccb2-e790-4a92-83de-a69a31817e0e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8222024-12-16T21:00:41.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b450f0d-7c61-4374-b8ba-84ed7052ea61 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8232024-12-16T21:00:41.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b450f0d-7c61-4374-b8ba-84ed7052ea61 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8242024-12-16T21:00:41.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b450f0d-7c61-4374-b8ba-84ed7052ea61 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8252024-12-16T21:00:42.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ff82b404-769e-4b27-8902-495ebda938ea roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8262024-12-16T21:00:42.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ff82b404-769e-4b27-8902-495ebda938ea resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8272024-12-16T21:00:42.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ff82b404-769e-4b27-8902-495ebda938ea response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8282024-12-16T21:00:42.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1575 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = f8985bc5-87b6-451f-9a6f-bdfe904bccef response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
8292024-12-16T21:00:43.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cbb3eebb-c643-4312-bec6-ade836c9f456 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8302024-12-16T21:00:43.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cbb3eebb-c643-4312-bec6-ade836c9f456 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8312024-12-16T21:00:43.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cbb3eebb-c643-4312-bec6-ade836c9f456 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8322024-12-16T21:00:44.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02ff9c53-c8ca-4e95-9890-bd4c8962ee50 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8332024-12-16T21:00:44.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02ff9c53-c8ca-4e95-9890-bd4c8962ee50 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8342024-12-16T21:00:44.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02ff9c53-c8ca-4e95-9890-bd4c8962ee50 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8352024-12-16T21:00:45.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 783a9cfc-f6c0-4ed6-b53d-2f5c14643e4d roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8362024-12-16T21:00:45.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 783a9cfc-f6c0-4ed6-b53d-2f5c14643e4d resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8372024-12-16T21:00:45.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 783a9cfc-f6c0-4ed6-b53d-2f5c14643e4d response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
8382024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
8392024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
8402024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8412024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
8422024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8432024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8442024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
8452024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
8462024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
8472024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8482024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8492024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8502024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8512024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8522024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8532024-12-16T21:00:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8542024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
8552024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
8562024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8572024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8582024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
8592024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8602024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8612024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
8622024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
8632024-12-16T21:00:45.967ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8642024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8652024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
8662024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8682024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
8692024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8702024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8712024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8722024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8732024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8742024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8752024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8762024-12-16T21:00:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8772024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
8792024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8802024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
8812024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8822024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
8832024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8842024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
8852024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8862024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8872024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8882024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8892024-12-16T21:00:45.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8902024-12-16T21:00:45.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8912024-12-16T21:00:45.969ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1774, tv_nsec: 499822814 } })
8922024-12-16T21:00:45.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-12-16T21:00:45.969ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
8942024-12-16T21:00:45.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.811363ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8952024-12-16T21:00:45.970ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1774, tv_nsec: 501102868 } })
8962024-12-16T21:00:45.971ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
8972024-12-16T21:00:45.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8982024-12-16T21:00:45.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8992024-12-16T21:00:45.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-12-16T21:00:45.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9012024-12-16T21:00:45.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9022024-12-16T21:00:45.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9032024-12-16T21:00:45.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9042024-12-16T21:00:45.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9052024-12-16T21:00:45.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9062024-12-16T21:00:45.973ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072024-12-16T21:00:45.975ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9082024-12-16T21:00:45.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9092024-12-16T21:00:45.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9102024-12-16T21:00:45.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9112024-12-16T21:00:45.975ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9122024-12-16T21:00:45.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9132024-12-16T21:00:45.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9142024-12-16T21:00:45.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152024-12-16T21:00:45.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9162024-12-16T21:00:45.978ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9172024-12-16T21:00:45.978ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.271496ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
9182024-12-16T21:00:45.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9192024-12-16T21:00:45.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9202024-12-16T21:00:45.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9212024-12-16T21:00:45.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9222024-12-16T21:00:45.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.336055ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9232024-12-16T21:00:45.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9242024-12-16T21:00:45.981ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9252024-12-16T21:00:45.981ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9262024-12-16T21:00:45.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9272024-12-16T21:00:45.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9282024-12-16T21:00:45.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9292024-12-16T21:00:45.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.319343ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9302024-12-16T21:00:45.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
9312024-12-16T21:00:45.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9322024-12-16T21:00:45.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9332024-12-16T21:00:45.986ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9342024-12-16T21:00:45.986ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.230987ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9352024-12-16T21:00:45.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362024-12-16T21:00:45.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9372024-12-16T21:00:45.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9382024-12-16T21:00:45.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9392024-12-16T21:00:45.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9402024-12-16T21:00:45.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9412024-12-16T21:00:46.006ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
9422024-12-16T21:00:46.006ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.29471ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
9432024-12-16T21:00:46.009ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9442024-12-16T21:00:46.009ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9452024-12-16T21:00:46.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9462024-12-16T21:00:46.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9472024-12-16T21:00:46.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9482024-12-16T21:00:46.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9492024-12-16T21:00:46.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9502024-12-16T21:00:46.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9512024-12-16T21:00:46.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522024-12-16T21:00:46.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9532024-12-16T21:00:46.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9542024-12-16T21:00:46.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9552024-12-16T21:00:46.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9562024-12-16T21:00:46.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9572024-12-16T21:00:46.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582024-12-16T21:00:46.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.009685ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
9592024-12-16T21:00:46.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
9602024-12-16T21:00:46.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9612024-12-16T21:00:46.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9622024-12-16T21:00:46.021ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1774, tv_nsec: 551496162 } })
9632024-12-16T21:00:46.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
9642024-12-16T21:00:46.022ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9652024-12-16T21:00:46.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9662024-12-16T21:00:46.023ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.5539ms iteration = 22 status = 0
9672024-12-16T21:00:46.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682024-12-16T21:00:46.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9692024-12-16T21:00:46.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9702024-12-16T21:00:46.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9712024-12-16T21:00:46.034ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.855806ms iteration = 26 status = {"physical_disks_added":0}
9722024-12-16T21:00:46.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
9732024-12-16T21:00:46.034ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9742024-12-16T21:00:46.034ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "608b07fe-14e3-4f03-86a0-0e5609a25c11", "content-length": "26", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
9752024-12-16T21:00:46.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9762024-12-16T21:00:46.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
9772024-12-16T21:00:46.036ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9782024-12-16T21:00:46.036ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c6701d5-2e35-403c-bdba-b0ef88280285", "content-length": "26", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
9792024-12-16T21:00:46.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9802024-12-16T21:00:46.037ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9812024-12-16T21:00:46.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9822024-12-16T21:00:46.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.810454ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
9832024-12-16T21:00:46.053ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9842024-12-16T21:00:46.053ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9852024-12-16T21:00:46.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9862024-12-16T21:00:46.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9872024-12-16T21:00:46.056ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9882024-12-16T21:00:46.056ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9892024-12-16T21:00:46.056ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.807607ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9902024-12-16T21:00:46.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.399568ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9912024-12-16T21:00:46.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9922024-12-16T21:00:46.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9932024-12-16T21:00:46.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9942024-12-16T21:00:46.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
9952024-12-16T21:00:46.096ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9962024-12-16T21:00:46.097ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "230b9714-96be-4089-96dc-2493a1eb9f32", "content-length": "26", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
9972024-12-16T21:00:46.097ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9982024-12-16T21:00:46.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9992024-12-16T21:00:46.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10002024-12-16T21:00:46.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
10012024-12-16T21:00:46.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10022024-12-16T21:00:46.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10032024-12-16T21:00:46.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10042024-12-16T21:00:46.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10052024-12-16T21:00:46.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10062024-12-16T21:00:46.117ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10072024-12-16T21:00:46.117ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c56c4221-73cb-4efa-ab34-5dc02a1d5e35", "content-length": "1", "date": "Mon, 16 Dec 2024 21:00:45 GMT"} })
10082024-12-16T21:00:46.119ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10092024-12-16T21:00:46.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10102024-12-16T21:00:46.124ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 158.297944ms iteration = 22 status = {}
10112024-12-16T21:00:46.167ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10122024-12-16T21:00:46.167ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10132024-12-16T21:00:46.167ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b6d2ed5-b93c-4a6c-b9bb-d750d8ece51b", "content-length": "372", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10142024-12-16T21:00:46.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152024-12-16T21:00:46.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10162024-12-16T21:00:46.169ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.958788ms iteration = 22 status = null
10172024-12-16T21:00:46.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9222275b-713b-4bb0-a353-0d5182537dad roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10182024-12-16T21:00:46.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9222275b-713b-4bb0-a353-0d5182537dad resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10192024-12-16T21:00:46.182ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
10202024-12-16T21:00:46.182ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10212024-12-16T21:00:46.182ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6286983c-2cf2-4ffc-b40d-b4df64e82298", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10222024-12-16T21:00:46.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10232024-12-16T21:00:46.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9222275b-713b-4bb0-a353-0d5182537dad response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10242024-12-16T21:00:46.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10252024-12-16T21:00:46.229ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10262024-12-16T21:00:46.230ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1645946b-cb25-4e0c-9016-c8c071e7d857", "content-length": "691", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10272024-12-16T21:00:46.230ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
10282024-12-16T21:00:46.230ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
10292024-12-16T21:00:46.230ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
10302024-12-16T21:00:46.231ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 263.515215ms iteration = 22 status = {}
10312024-12-16T21:00:46.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10322024-12-16T21:00:46.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10332024-12-16T21:00:46.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10342024-12-16T21:00:46.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10352024-12-16T21:00:46.238ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10362024-12-16T21:00:46.238ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10372024-12-16T21:00:46.239ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "26f91ce6-b3a7-4f22-9fe7-4802091254fa", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10382024-12-16T21:00:46.241ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 274.137998ms iteration = 23 status = {}
10392024-12-16T21:00:46.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10402024-12-16T21:00:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10412024-12-16T21:00:46.260ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
10422024-12-16T21:00:46.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10432024-12-16T21:00:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10442024-12-16T21:00:46.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
10452024-12-16T21:00:46.267ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d7c035c-f752-4c15-8aca-0b31382842a7", "content-length": "134", "date": "Mon, 16 Dec 2024 21:00:45 GMT"} })
10462024-12-16T21:00:46.267ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
10472024-12-16T21:00:46.267ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
10482024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10492024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10502024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10512024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10522024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10532024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10542024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10552024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10562024-12-16T21:00:46.268ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
10572024-12-16T21:00:46.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10582024-12-16T21:00:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10592024-12-16T21:00:46.270ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
10602024-12-16T21:00:46.270ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8f4c661-8c15-4e20-9ca3-7b6d90f8916f", "content-length": "2", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10612024-12-16T21:00:46.270ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
10622024-12-16T21:00:46.270ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c962a5d-2498-4609-8cea-ef10e0234c10", "content-length": "52", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10632024-12-16T21:00:46.270ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
10642024-12-16T21:00:46.270ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10652024-12-16T21:00:46.364ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4e02fd6b-3501-4398-80f8-be864e14d731", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10662024-12-16T21:00:46.364ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
10672024-12-16T21:00:46.364ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10682024-12-16T21:00:46.365ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "88829be1-9e72-4582-b720-709ccc357ebf", "content-length": "682", "date": "Mon, 16 Dec 2024 21:00:46 GMT"} })
10692024-12-16T21:00:46.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10702024-12-16T21:00:46.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10712024-12-16T21:00:46.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10722024-12-16T21:00:46.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10732024-12-16T21:00:46.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10742024-12-16T21:00:46.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10752024-12-16T21:00:46.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10762024-12-16T21:00:46.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10772024-12-16T21:00:46.380ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 412.581253ms iteration = 22 status = {}
10782024-12-16T21:00:47.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 8ce21253-5ac9-4f0b-87fd-4bee8b1b19da roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10792024-12-16T21:00:47.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 8ce21253-5ac9-4f0b-87fd-4bee8b1b19da resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10802024-12-16T21:00:47.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 8ce21253-5ac9-4f0b-87fd-4bee8b1b19da response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10812024-12-16T21:00:47.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3c6e7ed7-ac01-41f7-8a10-15c0c82008e3 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10822024-12-16T21:00:47.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3c6e7ed7-ac01-41f7-8a10-15c0c82008e3 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10832024-12-16T21:00:47.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3c6e7ed7-ac01-41f7-8a10-15c0c82008e3 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10842024-12-16T21:00:48.054ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58706
10852024-12-16T21:00:48.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58706 req_id = 686f6dd2-da34-4b62-bae2-738135092be8 roles = RoleSet { roles: {} } uri = /metrics/producers
10862024-12-16T21:00:48.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58706 req_id = 686f6dd2-da34-4b62-bae2-738135092be8 resource = Database result = Ok(()) uri = /metrics/producers
10872024-12-16T21:00:48.064ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 47a70e27-73d1-4499-a65e-1bb947c3cd95
10882024-12-16T21:00:48.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10047 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58706 req_id = 686f6dd2-da34-4b62-bae2-738135092be8 response_code = 201 uri = /metrics/producers
10892024-12-16T21:00:48.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f3857524-729f-4db5-8b29-929789080c5c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10902024-12-16T21:00:48.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f3857524-729f-4db5-8b29-929789080c5c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10912024-12-16T21:00:48.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f3857524-729f-4db5-8b29-929789080c5c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10922024-12-16T21:00:49.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a9773f79-19da-45bf-892a-d281b00633f3 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10932024-12-16T21:00:49.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a9773f79-19da-45bf-892a-d281b00633f3 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10942024-12-16T21:00:49.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a9773f79-19da-45bf-892a-d281b00633f3 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10952024-12-16T21:00:50.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ecf350d5-45e5-416c-bbc8-e46871c52b85 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10962024-12-16T21:00:50.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ecf350d5-45e5-416c-bbc8-e46871c52b85 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10972024-12-16T21:00:50.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ecf350d5-45e5-416c-bbc8-e46871c52b85 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10982024-12-16T21:00:51.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f8733107-9093-4574-9261-66b40a84cc04 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
10992024-12-16T21:00:51.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f8733107-9093-4574-9261-66b40a84cc04 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11002024-12-16T21:00:51.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f8733107-9093-4574-9261-66b40a84cc04 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11012024-12-16T21:00:52.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 2fd27f5d-933a-43e9-8dcd-785556809e8e response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
11022024-12-16T21:00:52.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f4023688-e698-4c57-8833-0540e39856dd roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11032024-12-16T21:00:52.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f4023688-e698-4c57-8833-0540e39856dd resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11042024-12-16T21:00:52.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f4023688-e698-4c57-8833-0540e39856dd response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11052024-12-16T21:00:53.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 28d8d099-4ba1-47d6-ab5b-5712b740faa0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11062024-12-16T21:00:53.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 28d8d099-4ba1-47d6-ab5b-5712b740faa0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11072024-12-16T21:00:53.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 28d8d099-4ba1-47d6-ab5b-5712b740faa0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11082024-12-16T21:00:54.299ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33704
11092024-12-16T21:00:54.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33704 req_id = acc5b24b-529f-4002-84d2-51c27f66bfde roles = RoleSet { roles: {} } uri = /metrics/producers
11102024-12-16T21:00:54.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33704 req_id = acc5b24b-529f-4002-84d2-51c27f66bfde resource = Database result = Ok(()) uri = /metrics/producers
11112024-12-16T21:00:54.309ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 1cd69a2a-1479-41ed-8e5f-7f5ded9cc538
11122024-12-16T21:00:54.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10322 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33704 req_id = acc5b24b-529f-4002-84d2-51c27f66bfde response_code = 201 uri = /metrics/producers
11132024-12-16T21:00:54.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3bcf8396-6b12-4bad-b697-14952a06ae0e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11142024-12-16T21:00:54.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3bcf8396-6b12-4bad-b697-14952a06ae0e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11152024-12-16T21:00:54.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3bcf8396-6b12-4bad-b697-14952a06ae0e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11162024-12-16T21:00:55.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 00641f24-bce8-49eb-b97d-9133dbced8ab roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11172024-12-16T21:00:55.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 00641f24-bce8-49eb-b97d-9133dbced8ab resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11182024-12-16T21:00:55.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 00641f24-bce8-49eb-b97d-9133dbced8ab response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11192024-12-16T21:00:55.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
11202024-12-16T21:00:55.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11212024-12-16T21:00:55.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11222024-12-16T21:00:55.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
11232024-12-16T21:00:55.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11242024-12-16T21:00:55.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11252024-12-16T21:00:55.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11262024-12-16T21:00:55.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11272024-12-16T21:00:55.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11282024-12-16T21:00:55.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.282502ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11292024-12-16T21:00:55.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11302024-12-16T21:00:55.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11312024-12-16T21:00:55.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11322024-12-16T21:00:55.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11332024-12-16T21:00:55.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11342024-12-16T21:00:55.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352024-12-16T21:00:55.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
11362024-12-16T21:00:55.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11372024-12-16T21:00:55.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11382024-12-16T21:00:55.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
11392024-12-16T21:00:55.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.489372ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
11402024-12-16T21:00:56.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 053b1de5-9f5a-4bf0-bd95-54b201aaee4a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11412024-12-16T21:00:56.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 053b1de5-9f5a-4bf0-bd95-54b201aaee4a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11422024-12-16T21:00:56.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 053b1de5-9f5a-4bf0-bd95-54b201aaee4a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11432024-12-16T21:00:57.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f45ddf1d-4f3e-4145-9383-c730d6ea6d6e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11442024-12-16T21:00:57.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f45ddf1d-4f3e-4145-9383-c730d6ea6d6e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11452024-12-16T21:00:57.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f45ddf1d-4f3e-4145-9383-c730d6ea6d6e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11462024-12-16T21:00:58.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0a9eb703-efec-40fb-8716-7ad01cdee077 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11472024-12-16T21:00:58.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0a9eb703-efec-40fb-8716-7ad01cdee077 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11482024-12-16T21:00:58.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0a9eb703-efec-40fb-8716-7ad01cdee077 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11492024-12-16T21:00:59.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9de7d79c-0d0a-45c7-b258-6df21c22276d roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11502024-12-16T21:00:59.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9de7d79c-0d0a-45c7-b258-6df21c22276d resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11512024-12-16T21:00:59.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9de7d79c-0d0a-45c7-b258-6df21c22276d response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11522024-12-16T21:01:00.171ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62258
11532024-12-16T21:01:00.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62258 req_id = 61e622e7-ec17-4954-921c-ed7be73196fb roles = RoleSet { roles: {} } uri = /metrics/producers
11542024-12-16T21:01:00.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62258 req_id = 61e622e7-ec17-4954-921c-ed7be73196fb resource = Database result = Ok(()) uri = /metrics/producers
11552024-12-16T21:01:00.182ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = fcb8d596-df56-4771-9db0-b88ea87e1f94
11562024-12-16T21:01:00.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10888 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62258 req_id = 61e622e7-ec17-4954-921c-ed7be73196fb response_code = 201 uri = /metrics/producers
11572024-12-16T21:01:00.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a95ab325-f41e-456b-8bfe-204d4cdda513 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11582024-12-16T21:01:00.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a95ab325-f41e-456b-8bfe-204d4cdda513 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11592024-12-16T21:01:00.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a95ab325-f41e-456b-8bfe-204d4cdda513 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11602024-12-16T21:01:01.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f665be2b-8a06-47ba-a431-3fd6b28496b9 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11612024-12-16T21:01:01.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f665be2b-8a06-47ba-a431-3fd6b28496b9 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11622024-12-16T21:01:01.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f665be2b-8a06-47ba-a431-3fd6b28496b9 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11632024-12-16T21:01:02.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1298 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 67d4d1b2-e542-49e5-9837-18f85b948bf8 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
11642024-12-16T21:01:02.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d686d788-868b-4f3b-bdd6-59325504445d roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11652024-12-16T21:01:02.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d686d788-868b-4f3b-bdd6-59325504445d resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11662024-12-16T21:01:02.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d686d788-868b-4f3b-bdd6-59325504445d response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11672024-12-16T21:01:03.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f897ab63-f7ae-4d83-b43a-9cd7256270ef roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11682024-12-16T21:01:03.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f897ab63-f7ae-4d83-b43a-9cd7256270ef resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11692024-12-16T21:01:03.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f897ab63-f7ae-4d83-b43a-9cd7256270ef response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11702024-12-16T21:01:04.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1bdbf900-82ad-4956-8732-a3bf714f341a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11712024-12-16T21:01:04.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1bdbf900-82ad-4956-8732-a3bf714f341a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11722024-12-16T21:01:04.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1bdbf900-82ad-4956-8732-a3bf714f341a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11732024-12-16T21:01:05.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4ffeba15-a061-46cc-98c2-f84e1a9a69d7 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11742024-12-16T21:01:05.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4ffeba15-a061-46cc-98c2-f84e1a9a69d7 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11752024-12-16T21:01:05.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4ffeba15-a061-46cc-98c2-f84e1a9a69d7 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11762024-12-16T21:01:05.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
11772024-12-16T21:01:05.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11782024-12-16T21:01:05.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11792024-12-16T21:01:05.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
11802024-12-16T21:01:05.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11812024-12-16T21:01:05.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11822024-12-16T21:01:05.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11832024-12-16T21:01:05.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11842024-12-16T21:01:05.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11852024-12-16T21:01:05.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.20204ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11862024-12-16T21:01:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11872024-12-16T21:01:05.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11882024-12-16T21:01:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11892024-12-16T21:01:05.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11902024-12-16T21:01:05.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11912024-12-16T21:01:05.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922024-12-16T21:01:05.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
11932024-12-16T21:01:05.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11942024-12-16T21:01:05.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11952024-12-16T21:01:05.988ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
11962024-12-16T21:01:05.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.534891ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
11972024-12-16T21:01:06.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 840dcd39-8544-4bb6-b1a8-dd7965cbbd12 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11982024-12-16T21:01:06.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 840dcd39-8544-4bb6-b1a8-dd7965cbbd12 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
11992024-12-16T21:01:06.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 840dcd39-8544-4bb6-b1a8-dd7965cbbd12 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12002024-12-16T21:01:07.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 474cb349-7652-495c-9760-ad20627ec2fd roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12012024-12-16T21:01:07.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 474cb349-7652-495c-9760-ad20627ec2fd resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12022024-12-16T21:01:07.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 474cb349-7652-495c-9760-ad20627ec2fd response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12032024-12-16T21:01:08.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cb0813d1-fba3-4b24-9776-e1edd57b9ddf roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12042024-12-16T21:01:08.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cb0813d1-fba3-4b24-9776-e1edd57b9ddf resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12052024-12-16T21:01:08.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cb0813d1-fba3-4b24-9776-e1edd57b9ddf response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12062024-12-16T21:01:09.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e41a336c-c80d-4702-a313-0640d047def1 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12072024-12-16T21:01:09.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e41a336c-c80d-4702-a313-0640d047def1 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12082024-12-16T21:01:09.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e41a336c-c80d-4702-a313-0640d047def1 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12092024-12-16T21:01:10.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0ab9395d-8f9b-4e8b-8150-9f40fe862c32 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12102024-12-16T21:01:10.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0ab9395d-8f9b-4e8b-8150-9f40fe862c32 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12112024-12-16T21:01:10.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0ab9395d-8f9b-4e8b-8150-9f40fe862c32 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12122024-12-16T21:01:11.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a3d08a18-068a-45f2-bf87-06a7cd9733bf roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12132024-12-16T21:01:11.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a3d08a18-068a-45f2-bf87-06a7cd9733bf resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12142024-12-16T21:01:11.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a3d08a18-068a-45f2-bf87-06a7cd9733bf response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12152024-12-16T21:01:12.187ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 94d6c7f6-d65d-498e-bbe7-c104aeec9cbe response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
12162024-12-16T21:01:12.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c2bc4dd9-b342-4ff2-991e-91ad22a83f29 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12172024-12-16T21:01:12.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c2bc4dd9-b342-4ff2-991e-91ad22a83f29 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12182024-12-16T21:01:12.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c2bc4dd9-b342-4ff2-991e-91ad22a83f29 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12192024-12-16T21:01:13.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7bc3029b-adb2-46bc-860f-37ccd81fecbc roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12202024-12-16T21:01:13.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7bc3029b-adb2-46bc-860f-37ccd81fecbc resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12212024-12-16T21:01:13.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7bc3029b-adb2-46bc-860f-37ccd81fecbc response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12222024-12-16T21:01:14.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6bc3f4c1-15b6-40c4-a3b8-970a7c963fb4 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12232024-12-16T21:01:14.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6bc3f4c1-15b6-40c4-a3b8-970a7c963fb4 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12242024-12-16T21:01:14.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6bc3f4c1-15b6-40c4-a3b8-970a7c963fb4 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12252024-12-16T21:01:15.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8df9482c-6add-4f95-ab2b-264c60cd3e82 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12262024-12-16T21:01:15.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8df9482c-6add-4f95-ab2b-264c60cd3e82 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12272024-12-16T21:01:15.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8df9482c-6add-4f95-ab2b-264c60cd3e82 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
12282024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
12292024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
12302024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12312024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
12322024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12332024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
12342024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
12352024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
12362024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12372024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
12382024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
12392024-12-16T21:01:15.966ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-16 20:51:15.966474382 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
12402024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12412024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
12422024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
12432024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
12442024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
12452024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12462024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12472024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
12482024-12-16T21:01:15.966ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
12492024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12502024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
12512024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12522024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12532024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12542024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12552024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12562024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
12572024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12582024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12592024-12-16T21:01:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12602024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12612024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
12622024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
12632024-12-16T21:01:15.967ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12642024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12652024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12662024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
12672024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12682024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
12692024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12702024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
12712024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
12722024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12732024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
12742024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
12752024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12762024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12772024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
12782024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12792024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
12802024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12812024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
12822024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12832024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
12842024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12852024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
12862024-12-16T21:01:15.967ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546
12872024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
12882024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.2\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546"}
12892024-12-16T21:01:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12902024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12912024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12922024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12932024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12942024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12952024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12962024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12972024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12982024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12992024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
13002024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13012024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
13022024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13032024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
13042024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13052024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
13062024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13072024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
13082024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13092024-12-16T21:01:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2bad804c-125d-4b4f-bbb4-08849c8bee33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e73705b-19c3-4191-883c-2bba82160d3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 498518023 } })
13102024-12-16T21:01:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2119cbc5-42cf-405b-af5a-3fb6ae08bc7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 498594924 } })
13112024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13122024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13132024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13142024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13152024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13162024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
13172024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.04119ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
13182024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
13192024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.229334ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
13202024-12-16T21:01:15.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13212024-12-16T21:01:15.968ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 499187156 } })
13222024-12-16T21:01:15.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-12-16T21:01:15.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13242024-12-16T21:01:15.969ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252024-12-16T21:01:15.969ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
13262024-12-16T21:01:15.969ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.384825ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13272024-12-16T21:01:15.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13282024-12-16T21:01:15.970ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-16 20:51:15.966474382 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
13292024-12-16T21:01:15.970ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.400594ms iteration = 12 status = {"expiration":"2024-12-16T20:51:15.966474382Z","pruned":[]}
13302024-12-16T21:01:15.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
13312024-12-16T21:01:15.971ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13322024-12-16T21:01:15.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13332024-12-16T21:01:15.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13342024-12-16T21:01:15.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13352024-12-16T21:01:15.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13362024-12-16T21:01:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13372024-12-16T21:01:15.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13382024-12-16T21:01:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13392024-12-16T21:01:15.974ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13402024-12-16T21:01:15.974ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 505020967 } })
13412024-12-16T21:01:15.975ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
13422024-12-16T21:01:15.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13432024-12-16T21:01:15.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13442024-12-16T21:01:15.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13452024-12-16T21:01:15.976ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13462024-12-16T21:01:15.976ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13472024-12-16T21:01:15.976ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13482024-12-16T21:01:15.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13492024-12-16T21:01:15.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13502024-12-16T21:01:15.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13512024-12-16T21:01:15.977ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13522024-12-16T21:01:15.977ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13532024-12-16T21:01:15.977ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.351548ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13542024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13552024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13562024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13572024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13582024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13592024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13602024-12-16T21:01:15.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13612024-12-16T21:01:15.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13622024-12-16T21:01:15.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13632024-12-16T21:01:15.980ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13642024-12-16T21:01:15.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13652024-12-16T21:01:15.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13662024-12-16T21:01:15.982ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13672024-12-16T21:01:15.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13682024-12-16T21:01:15.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692024-12-16T21:01:15.985ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.305611ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
13702024-12-16T21:01:15.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.472793ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
13712024-12-16T21:01:15.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13722024-12-16T21:01:15.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13732024-12-16T21:01:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13742024-12-16T21:01:15.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13752024-12-16T21:01:15.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13762024-12-16T21:01:15.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13772024-12-16T21:01:15.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13782024-12-16T21:01:15.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13792024-12-16T21:01:15.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13802024-12-16T21:01:15.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13812024-12-16T21:01:15.995ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13822024-12-16T21:01:15.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13832024-12-16T21:01:15.996ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13842024-12-16T21:01:15.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13852024-12-16T21:01:15.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13862024-12-16T21:01:16.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-12-16T21:01:16.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13882024-12-16T21:01:16.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892024-12-16T21:01:16.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13902024-12-16T21:01:16.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.12787ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13912024-12-16T21:01:16.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13922024-12-16T21:01:16.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13932024-12-16T21:01:16.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13942024-12-16T21:01:16.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 39.923043ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13952024-12-16T21:01:16.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13962024-12-16T21:01:16.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13972024-12-16T21:01:16.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-12-16T21:01:16.009ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13992024-12-16T21:01:16.009ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14002024-12-16T21:01:16.009ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14012024-12-16T21:01:16.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14022024-12-16T21:01:16.009ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1804, tv_nsec: 539459765 } })
14032024-12-16T21:01:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14042024-12-16T21:01:16.009ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
14052024-12-16T21:01:16.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14062024-12-16T21:01:16.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14072024-12-16T21:01:16.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14082024-12-16T21:01:16.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
14092024-12-16T21:01:16.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14102024-12-16T21:01:16.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14112024-12-16T21:01:16.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122024-12-16T21:01:16.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14132024-12-16T21:01:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14142024-12-16T21:01:16.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14152024-12-16T21:01:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14162024-12-16T21:01:16.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14172024-12-16T21:01:16.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14182024-12-16T21:01:16.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14192024-12-16T21:01:16.025ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14202024-12-16T21:01:16.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14212024-12-16T21:01:16.033ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14222024-12-16T21:01:16.033ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14232024-12-16T21:01:16.034ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.430918ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14242024-12-16T21:01:16.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14252024-12-16T21:01:16.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14262024-12-16T21:01:16.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.610592ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
14272024-12-16T21:01:16.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14282024-12-16T21:01:16.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14292024-12-16T21:01:16.040ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14302024-12-16T21:01:16.040ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14312024-12-16T21:01:16.040ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14322024-12-16T21:01:16.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14332024-12-16T21:01:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14342024-12-16T21:01:16.041ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14352024-12-16T21:01:16.041ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14362024-12-16T21:01:16.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14372024-12-16T21:01:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14382024-12-16T21:01:16.055ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14392024-12-16T21:01:16.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.026992ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14402024-12-16T21:01:16.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14412024-12-16T21:01:16.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14422024-12-16T21:01:16.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14432024-12-16T21:01:16.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14442024-12-16T21:01:16.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14452024-12-16T21:01:16.131ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14462024-12-16T21:01:16.131ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7e68319-4a83-4358-a04d-5b0c7d202751", "content-length": "26", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
14472024-12-16T21:01:16.131ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14482024-12-16T21:01:16.132ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14492024-12-16T21:01:16.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
14502024-12-16T21:01:16.164ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14512024-12-16T21:01:16.164ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a4d47f4-9e3d-4dd9-9a2b-4b2c303511cd", "content-length": "26", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
14522024-12-16T21:01:16.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14532024-12-16T21:01:16.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
14542024-12-16T21:01:16.182ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14552024-12-16T21:01:16.182ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14562024-12-16T21:01:16.183ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1445c247-5f19-4e7e-829f-55774bbebab2", "content-length": "372", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
14572024-12-16T21:01:16.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14582024-12-16T21:01:16.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14592024-12-16T21:01:16.186ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14602024-12-16T21:01:16.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14612024-12-16T21:01:16.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14622024-12-16T21:01:16.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14632024-12-16T21:01:16.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14642024-12-16T21:01:16.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14652024-12-16T21:01:16.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14662024-12-16T21:01:16.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14672024-12-16T21:01:16.196ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
14682024-12-16T21:01:16.196ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 229.815191ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
14692024-12-16T21:01:16.216ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 248.534839ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14702024-12-16T21:01:16.216ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14712024-12-16T21:01:16.216ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 0 version = 2
14722024-12-16T21:01:16.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14732024-12-16T21:01:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14742024-12-16T21:01:16.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14752024-12-16T21:01:16.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-12-16T21:01:16.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 252.926753ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14772024-12-16T21:01:16.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14782024-12-16T21:01:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14792024-12-16T21:01:16.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14802024-12-16T21:01:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14812024-12-16T21:01:16.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822024-12-16T21:01:16.224ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 1 version = 2
14832024-12-16T21:01:16.224ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14842024-12-16T21:01:16.224ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-16 20:50:36.849175 UTC dns_group = external generation = 2
14852024-12-16T21:01:16.224ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 256.670104ms iteration = 13 status = {"generation":2}
14862024-12-16T21:01:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14872024-12-16T21:01:16.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14882024-12-16T21:01:16.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14892024-12-16T21:01:16.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14902024-12-16T21:01:16.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14912024-12-16T21:01:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14922024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
14932024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14942024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14952024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14962024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14972024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14982024-12-16T21:01:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14992024-12-16T21:01:16.228ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15002024-12-16T21:01:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15012024-12-16T21:01:16.229ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 262.513687ms iteration = 23 status = 0
15022024-12-16T21:01:16.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15032024-12-16T21:01:16.229ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15042024-12-16T21:01:16.229ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15052024-12-16T21:01:16.229ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 262.227241ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15062024-12-16T21:01:16.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072024-12-16T21:01:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15082024-12-16T21:01:16.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15092024-12-16T21:01:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15102024-12-16T21:01:16.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15112024-12-16T21:01:16.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15122024-12-16T21:01:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15132024-12-16T21:01:16.235ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15142024-12-16T21:01:16.235ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15152024-12-16T21:01:16.235ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-16 20:50:36.066577 UTC dns_group = internal generation = 1
15162024-12-16T21:01:16.235ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 269.075441ms iteration = 13 status = {"generation":1}
15172024-12-16T21:01:16.241ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15182024-12-16T21:01:16.241ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15192024-12-16T21:01:16.241ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "13967f48-3974-45a2-bf4b-90a28674dff0", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15202024-12-16T21:01:16.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15212024-12-16T21:01:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15222024-12-16T21:01:16.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15232024-12-16T21:01:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15242024-12-16T21:01:16.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15252024-12-16T21:01:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15262024-12-16T21:01:16.253ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15272024-12-16T21:01:16.253ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15282024-12-16T21:01:16.253ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a37c6362-84d2-4dcd-a8e3-130f386b292f", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15292024-12-16T21:01:16.255ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.85234ms iteration = 24 status = {}
15302024-12-16T21:01:16.269ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-16T20:50:11.628239Z, time_modified: 2024-12-16T20:50:11.628239Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }) }
15312024-12-16T21:01:16.269ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 302.648022ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]}},"default_endpoint":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15322024-12-16T21:01:16.290ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
15332024-12-16T21:01:16.290ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 323.341438ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15342024-12-16T21:01:16.295ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 329.394883ms iteration = 27 status = {"physical_disks_added":0}
15352024-12-16T21:01:16.308ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 342.082326ms iteration = 23 status = {}
15362024-12-16T21:01:16.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15372024-12-16T21:01:16.356ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15382024-12-16T21:01:16.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15392024-12-16T21:01:16.368ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15402024-12-16T21:01:16.368ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82eecb16-c960-43cc-ad30-8f4371594d45", "content-length": "26", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15412024-12-16T21:01:16.368ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15422024-12-16T21:01:16.370ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15432024-12-16T21:01:16.547ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15442024-12-16T21:01:16.547ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2640b7d-ee9d-4fdd-bd4f-ad18fa443429", "content-length": "1", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15452024-12-16T21:01:16.549ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15462024-12-16T21:01:16.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15472024-12-16T21:01:16.551ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15482024-12-16T21:01:16.552ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a96e258-9a8d-4a95-9552-65a37c789b9e", "content-length": "691", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15492024-12-16T21:01:16.552ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15502024-12-16T21:01:16.552ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15512024-12-16T21:01:16.552ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15522024-12-16T21:01:16.553ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 587.512186ms iteration = 23 status = null
15532024-12-16T21:01:16.554ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 586.68619ms iteration = 23 status = {}
15542024-12-16T21:01:16.607ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15552024-12-16T21:01:16.607ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15562024-12-16T21:01:16.608ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "244db348-c173-48c3-8974-512dc805efb2", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15572024-12-16T21:01:16.608ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15582024-12-16T21:01:16.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "173b1ed7-19f4-40a4-a2d5-3d78eb1c68e5", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15592024-12-16T21:01:16.609ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15602024-12-16T21:01:16.612ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15612024-12-16T21:01:16.612ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 645.653387ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15622024-12-16T21:01:16.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15632024-12-16T21:01:16.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15642024-12-16T21:01:16.654ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
15652024-12-16T21:01:16.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15662024-12-16T21:01:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15672024-12-16T21:01:16.660ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15682024-12-16T21:01:16.661ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ecdadb97-ebf6-4c6e-9ce9-ad202b2a30c3", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15692024-12-16T21:01:16.661ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15702024-12-16T21:01:16.661ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15712024-12-16T21:01:16.662ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c99e924-3598-4f05-8422-a70082a4b06f", "content-length": "134", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15722024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15732024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
15742024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15752024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15762024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15772024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15782024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15792024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15802024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15812024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15822024-12-16T21:01:16.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8f9be499-c25d-4b82-931a-3aa60105a988", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15832024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15842024-12-16T21:01:16.662ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
15852024-12-16T21:01:16.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15862024-12-16T21:01:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15872024-12-16T21:01:16.664ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6644462f-50c0-4ed2-a5dc-e644bcb6fad3", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15882024-12-16T21:01:16.664ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15892024-12-16T21:01:16.665ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15902024-12-16T21:01:16.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a64e849-39fa-4309-b1df-b0059ae85a61", "content-length": "2", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15912024-12-16T21:01:16.665ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15922024-12-16T21:01:16.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b6c67e-2467-42b6-b5a2-01b48cdc4dbf", "content-length": "52", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15932024-12-16T21:01:16.665ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
15942024-12-16T21:01:16.665ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15952024-12-16T21:01:16.666ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
15962024-12-16T21:01:16.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 699.924023ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15972024-12-16T21:01:16.764ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "486bab21-9add-4e1b-b834-85d8f8365b8d", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
15982024-12-16T21:01:16.764ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
15992024-12-16T21:01:16.764ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16002024-12-16T21:01:16.765ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "42347d79-a3b2-43b8-84be-21867dd649fe", "content-length": "682", "date": "Mon, 16 Dec 2024 21:01:16 GMT"} })
16012024-12-16T21:01:16.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16022024-12-16T21:01:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16032024-12-16T21:01:16.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16042024-12-16T21:01:16.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16052024-12-16T21:01:16.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16062024-12-16T21:01:16.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16072024-12-16T21:01:16.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16082024-12-16T21:01:16.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16092024-12-16T21:01:16.781ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 813.370132ms iteration = 23 status = {}
16102024-12-16T21:01:16.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 35176a70-be62-42d8-a2af-56d93e481d92 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16112024-12-16T21:01:16.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 35176a70-be62-42d8-a2af-56d93e481d92 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16122024-12-16T21:01:16.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 35176a70-be62-42d8-a2af-56d93e481d92 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16132024-12-16T21:01:17.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 5c5dd917-f03b-494f-9868-1f84a787827d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16142024-12-16T21:01:17.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 5c5dd917-f03b-494f-9868-1f84a787827d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16152024-12-16T21:01:17.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 5c5dd917-f03b-494f-9868-1f84a787827d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16162024-12-16T21:01:17.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 89eb2485-0221-4eba-9e87-ec9e1e0b4b06 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16172024-12-16T21:01:17.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 89eb2485-0221-4eba-9e87-ec9e1e0b4b06 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16182024-12-16T21:01:17.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 89eb2485-0221-4eba-9e87-ec9e1e0b4b06 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16192024-12-16T21:01:18.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b2c96876-4235-47cf-b322-cba43a683657 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16202024-12-16T21:01:18.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b2c96876-4235-47cf-b322-cba43a683657 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16212024-12-16T21:01:18.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b2c96876-4235-47cf-b322-cba43a683657 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16222024-12-16T21:01:19.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 891c655d-5db9-4f1f-879a-cdf047126f9a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16232024-12-16T21:01:19.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 891c655d-5db9-4f1f-879a-cdf047126f9a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16242024-12-16T21:01:19.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 891c655d-5db9-4f1f-879a-cdf047126f9a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16252024-12-16T21:01:20.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c12bc162-b49c-41cc-a315-eaa25e7551a0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16262024-12-16T21:01:20.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c12bc162-b49c-41cc-a315-eaa25e7551a0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16272024-12-16T21:01:20.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c12bc162-b49c-41cc-a315-eaa25e7551a0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16282024-12-16T21:01:22.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f5b31003-c3c2-44b7-bc80-ee8e280b1dcf roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16292024-12-16T21:01:22.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f5b31003-c3c2-44b7-bc80-ee8e280b1dcf resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16302024-12-16T21:01:22.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f5b31003-c3c2-44b7-bc80-ee8e280b1dcf response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16312024-12-16T21:01:22.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1346 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = b2936cdc-3528-49a9-b528-71ee33d4f24c response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
16322024-12-16T21:01:23.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6939242d-d967-467f-8ba5-70d1edc99058 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16332024-12-16T21:01:23.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6939242d-d967-467f-8ba5-70d1edc99058 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16342024-12-16T21:01:23.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6939242d-d967-467f-8ba5-70d1edc99058 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16352024-12-16T21:01:24.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 92eddee9-db10-4493-adc4-9b95611e4b7c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16362024-12-16T21:01:24.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 92eddee9-db10-4493-adc4-9b95611e4b7c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16372024-12-16T21:01:24.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 92eddee9-db10-4493-adc4-9b95611e4b7c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16382024-12-16T21:01:25.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7fb8e535-6dd5-4bf5-b9ec-3260f614b466 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16392024-12-16T21:01:25.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7fb8e535-6dd5-4bf5-b9ec-3260f614b466 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16402024-12-16T21:01:25.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7fb8e535-6dd5-4bf5-b9ec-3260f614b466 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16412024-12-16T21:01:25.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
16422024-12-16T21:01:25.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16432024-12-16T21:01:25.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16442024-12-16T21:01:25.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
16452024-12-16T21:01:25.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16462024-12-16T21:01:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16472024-12-16T21:01:25.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16482024-12-16T21:01:25.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16492024-12-16T21:01:25.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16502024-12-16T21:01:25.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16512024-12-16T21:01:25.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16522024-12-16T21:01:25.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.986146ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16532024-12-16T21:01:25.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16542024-12-16T21:01:25.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16552024-12-16T21:01:25.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16562024-12-16T21:01:25.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572024-12-16T21:01:25.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
16582024-12-16T21:01:25.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16592024-12-16T21:01:25.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16602024-12-16T21:01:25.986ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
16612024-12-16T21:01:25.986ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.005702ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
16622024-12-16T21:01:26.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a4c2c9c-de18-429f-8755-23efb972a6c0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16632024-12-16T21:01:26.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a4c2c9c-de18-429f-8755-23efb972a6c0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16642024-12-16T21:01:26.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a4c2c9c-de18-429f-8755-23efb972a6c0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16652024-12-16T21:01:27.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 97ee8966-285d-4e14-8d33-438a215674f2 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16662024-12-16T21:01:27.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 97ee8966-285d-4e14-8d33-438a215674f2 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16672024-12-16T21:01:27.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 97ee8966-285d-4e14-8d33-438a215674f2 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16682024-12-16T21:01:28.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b773c6f-40c0-4be7-84b1-2707113f16d6 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16692024-12-16T21:01:28.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b773c6f-40c0-4be7-84b1-2707113f16d6 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16702024-12-16T21:01:28.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b773c6f-40c0-4be7-84b1-2707113f16d6 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16712024-12-16T21:01:29.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b9fbeb5-38c4-4fd2-8efb-f9b52d14954c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16722024-12-16T21:01:29.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b9fbeb5-38c4-4fd2-8efb-f9b52d14954c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16732024-12-16T21:01:29.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b9fbeb5-38c4-4fd2-8efb-f9b52d14954c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16742024-12-16T21:01:30.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6effc4bd-fbf8-418e-b82a-69a122c96375 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16752024-12-16T21:01:30.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6effc4bd-fbf8-418e-b82a-69a122c96375 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16762024-12-16T21:01:30.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6effc4bd-fbf8-418e-b82a-69a122c96375 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16772024-12-16T21:01:31.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 732dbeb2-18ed-45e4-bbe7-08b8ae640d43 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16782024-12-16T21:01:31.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 732dbeb2-18ed-45e4-bbe7-08b8ae640d43 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16792024-12-16T21:01:31.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 732dbeb2-18ed-45e4-bbe7-08b8ae640d43 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16802024-12-16T21:01:32.187ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1437 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 5717e9c7-db0e-42b0-9775-9904c5a56a66 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
16812024-12-16T21:01:32.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a07e6bf-554a-4511-9149-0cae14672c8c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16822024-12-16T21:01:32.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a07e6bf-554a-4511-9149-0cae14672c8c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16832024-12-16T21:01:32.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a07e6bf-554a-4511-9149-0cae14672c8c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16842024-12-16T21:01:33.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 33162d5b-bcc6-46a4-9160-19187535691e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16852024-12-16T21:01:33.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 33162d5b-bcc6-46a4-9160-19187535691e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16862024-12-16T21:01:33.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 33162d5b-bcc6-46a4-9160-19187535691e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16872024-12-16T21:01:34.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = baf00578-758b-491b-87f1-90693023a294 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16882024-12-16T21:01:34.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = baf00578-758b-491b-87f1-90693023a294 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16892024-12-16T21:01:34.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = baf00578-758b-491b-87f1-90693023a294 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16902024-12-16T21:01:35.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 993eb79a-e38b-4dc1-a40d-e796c308c9e8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16912024-12-16T21:01:35.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 993eb79a-e38b-4dc1-a40d-e796c308c9e8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16922024-12-16T21:01:35.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 993eb79a-e38b-4dc1-a40d-e796c308c9e8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
16932024-12-16T21:01:35.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
16942024-12-16T21:01:35.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16952024-12-16T21:01:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16962024-12-16T21:01:35.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
16972024-12-16T21:01:35.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16982024-12-16T21:01:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16992024-12-16T21:01:35.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17002024-12-16T21:01:35.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17012024-12-16T21:01:35.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17022024-12-16T21:01:35.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.218501ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17032024-12-16T21:01:35.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17042024-12-16T21:01:35.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17052024-12-16T21:01:35.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17062024-12-16T21:01:35.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17072024-12-16T21:01:35.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17082024-12-16T21:01:35.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17092024-12-16T21:01:35.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
17102024-12-16T21:01:35.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17112024-12-16T21:01:35.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17122024-12-16T21:01:35.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
17132024-12-16T21:01:35.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.311808ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
17142024-12-16T21:01:36.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 450f4bc3-fc27-496c-b778-52f162641986 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17152024-12-16T21:01:36.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 450f4bc3-fc27-496c-b778-52f162641986 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17162024-12-16T21:01:36.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 450f4bc3-fc27-496c-b778-52f162641986 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17172024-12-16T21:01:37.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9e3d0b98-482e-475f-8af7-feb30d05aaa8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17182024-12-16T21:01:37.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9e3d0b98-482e-475f-8af7-feb30d05aaa8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17192024-12-16T21:01:37.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9e3d0b98-482e-475f-8af7-feb30d05aaa8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17202024-12-16T21:01:38.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8ac7df47-6d37-43fe-ac42-ff9d8b875cd9 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17212024-12-16T21:01:38.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8ac7df47-6d37-43fe-ac42-ff9d8b875cd9 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17222024-12-16T21:01:38.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8ac7df47-6d37-43fe-ac42-ff9d8b875cd9 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17232024-12-16T21:01:39.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e3a2fea-e7f1-4d77-a3b9-042ad959ac61 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17242024-12-16T21:01:39.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e3a2fea-e7f1-4d77-a3b9-042ad959ac61 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17252024-12-16T21:01:39.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e3a2fea-e7f1-4d77-a3b9-042ad959ac61 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17262024-12-16T21:01:40.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2aed88c8-5182-4f42-a1b4-325e6fb90ede roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17272024-12-16T21:01:40.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2aed88c8-5182-4f42-a1b4-325e6fb90ede resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17282024-12-16T21:01:40.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2aed88c8-5182-4f42-a1b4-325e6fb90ede response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17292024-12-16T21:01:41.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 71ea281b-5018-4fc6-ae45-651ce190f4c3 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17302024-12-16T21:01:41.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 71ea281b-5018-4fc6-ae45-651ce190f4c3 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17312024-12-16T21:01:41.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 71ea281b-5018-4fc6-ae45-651ce190f4c3 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17322024-12-16T21:01:42.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1312 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = cef6b672-be47-4d90-a4ac-660bc39ac187 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
17332024-12-16T21:01:42.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f605d435-d8f4-4dff-ac31-a7289d8a74d0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17342024-12-16T21:01:42.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f605d435-d8f4-4dff-ac31-a7289d8a74d0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17352024-12-16T21:01:42.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f605d435-d8f4-4dff-ac31-a7289d8a74d0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17362024-12-16T21:01:43.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc54bba9-11d5-47c9-a6a8-6f40d8dfbb96 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17372024-12-16T21:01:43.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc54bba9-11d5-47c9-a6a8-6f40d8dfbb96 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17382024-12-16T21:01:43.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc54bba9-11d5-47c9-a6a8-6f40d8dfbb96 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17392024-12-16T21:01:44.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 474d6af1-1f16-4554-af09-f92434ae1afa roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17402024-12-16T21:01:44.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 474d6af1-1f16-4554-af09-f92434ae1afa resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17412024-12-16T21:01:44.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 474d6af1-1f16-4554-af09-f92434ae1afa response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17422024-12-16T21:01:45.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f7b9bd2f-87c5-4ae6-8d67-33022c6d799c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17432024-12-16T21:01:45.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f7b9bd2f-87c5-4ae6-8d67-33022c6d799c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17442024-12-16T21:01:45.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f7b9bd2f-87c5-4ae6-8d67-33022c6d799c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
17452024-12-16T21:01:45.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
17462024-12-16T21:01:45.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
17472024-12-16T21:01:45.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17482024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
17492024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17502024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
17512024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17522024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
17532024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17542024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
17552024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
17562024-12-16T21:01:45.967ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17572024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
17582024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17592024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17602024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17612024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
17622024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17632024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
17642024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17652024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
17662024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17672024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17682024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
17692024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17702024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
17712024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17722024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17732024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17742024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17752024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17762024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17772024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17782024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17792024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17802024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17812024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17822024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17832024-12-16T21:01:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17842024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
17852024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
17862024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17872024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17882024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
17892024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17902024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
17912024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17922024-12-16T21:01:45.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17932024-12-16T21:01:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17942024-12-16T21:01:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17952024-12-16T21:01:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17962024-12-16T21:01:45.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972024-12-16T21:01:45.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17982024-12-16T21:01:45.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992024-12-16T21:01:45.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-12-16T21:01:45.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.013147ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18012024-12-16T21:01:45.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18022024-12-16T21:01:45.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18032024-12-16T21:01:45.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18042024-12-16T21:01:45.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18052024-12-16T21:01:45.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18062024-12-16T21:01:45.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18072024-12-16T21:01:45.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18082024-12-16T21:01:45.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18092024-12-16T21:01:45.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18102024-12-16T21:01:45.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18112024-12-16T21:01:45.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18122024-12-16T21:01:45.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18132024-12-16T21:01:45.974ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1834, tv_nsec: 505165251 } })
18142024-12-16T21:01:45.975ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18152024-12-16T21:01:45.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162024-12-16T21:01:45.976ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1834, tv_nsec: 506911255 } })
18172024-12-16T21:01:45.976ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18182024-12-16T21:01:45.976ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18192024-12-16T21:01:45.977ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18202024-12-16T21:01:45.977ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18212024-12-16T21:01:45.977ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18222024-12-16T21:01:45.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18232024-12-16T21:01:45.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242024-12-16T21:01:45.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18252024-12-16T21:01:45.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18262024-12-16T21:01:45.978ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18272024-12-16T21:01:45.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18282024-12-16T21:01:45.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18292024-12-16T21:01:45.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18302024-12-16T21:01:45.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18312024-12-16T21:01:45.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18322024-12-16T21:01:45.981ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18332024-12-16T21:01:45.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18342024-12-16T21:01:45.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18352024-12-16T21:01:45.982ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18362024-12-16T21:01:45.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18372024-12-16T21:01:45.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18382024-12-16T21:01:45.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18392024-12-16T21:01:45.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18402024-12-16T21:01:45.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18412024-12-16T21:01:45.984ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18422024-12-16T21:01:45.984ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18432024-12-16T21:01:45.984ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18442024-12-16T21:01:45.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18452024-12-16T21:01:45.986ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1834, tv_nsec: 517321103 } })
18462024-12-16T21:01:45.987ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
18472024-12-16T21:01:45.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18482024-12-16T21:01:45.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
18492024-12-16T21:01:45.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18502024-12-16T21:01:45.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18512024-12-16T21:01:46.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18522024-12-16T21:01:46.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18532024-12-16T21:01:46.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.105551ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18542024-12-16T21:01:46.014ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18552024-12-16T21:01:46.014ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
18562024-12-16T21:01:46.014ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.033508ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
18572024-12-16T21:01:46.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18582024-12-16T21:01:46.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.341464ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
18592024-12-16T21:01:46.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.048897ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
18602024-12-16T21:01:46.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18612024-12-16T21:01:46.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18622024-12-16T21:01:46.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18632024-12-16T21:01:46.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18642024-12-16T21:01:46.023ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18652024-12-16T21:01:46.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18662024-12-16T21:01:46.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672024-12-16T21:01:46.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
18682024-12-16T21:01:46.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18692024-12-16T21:01:46.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18702024-12-16T21:01:46.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712024-12-16T21:01:46.028ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.440874ms iteration = 24 status = 0
18722024-12-16T21:01:46.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18732024-12-16T21:01:46.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18742024-12-16T21:01:46.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18752024-12-16T21:01:46.031ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18762024-12-16T21:01:46.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.786658ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18772024-12-16T21:01:46.034ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18782024-12-16T21:01:46.034ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18792024-12-16T21:01:46.034ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.094512ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18802024-12-16T21:01:46.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.757528ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18812024-12-16T21:01:46.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18822024-12-16T21:01:46.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18832024-12-16T21:01:46.049ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18842024-12-16T21:01:46.049ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18852024-12-16T21:01:46.049ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f753b3e-28bb-4e92-8bb1-33f805d80814", "content-length": "26", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
18862024-12-16T21:01:46.049ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18872024-12-16T21:01:46.052ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18882024-12-16T21:01:46.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.898793ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18892024-12-16T21:01:46.057ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18902024-12-16T21:01:46.057ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18912024-12-16T21:01:46.057ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e422a5a-93a4-4e74-8e9c-c7cd93f76f1d", "content-length": "26", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
18922024-12-16T21:01:46.057ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18932024-12-16T21:01:46.059ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18942024-12-16T21:01:46.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.766921ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18952024-12-16T21:01:46.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18962024-12-16T21:01:46.083ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
18972024-12-16T21:01:46.083ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18982024-12-16T21:01:46.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18992024-12-16T21:01:46.083ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f77ed62-543e-43e8-9754-f2b23cf215cf", "content-length": "26", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19002024-12-16T21:01:46.083ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19012024-12-16T21:01:46.084ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
19022024-12-16T21:01:46.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19032024-12-16T21:01:46.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19042024-12-16T21:01:46.116ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.019206ms iteration = 28 status = {"physical_disks_added":0}
19052024-12-16T21:01:46.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062024-12-16T21:01:46.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19072024-12-16T21:01:46.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19082024-12-16T21:01:46.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19092024-12-16T21:01:46.156ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19102024-12-16T21:01:46.156ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19112024-12-16T21:01:46.157ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "44a3f8c6-3b8a-42a5-84a5-99735d035ceb", "content-length": "372", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19122024-12-16T21:01:46.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19132024-12-16T21:01:46.157ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.273775ms iteration = 24 status = {}
19142024-12-16T21:01:46.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19152024-12-16T21:01:46.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19162024-12-16T21:01:46.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19172024-12-16T21:01:46.160ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19182024-12-16T21:01:46.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19192024-12-16T21:01:46.161ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19202024-12-16T21:01:46.161ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b041a230-bdb3-4a41-b9c5-da52081befe3", "content-length": "1", "date": "Mon, 16 Dec 2024 21:01:45 GMT"} })
19212024-12-16T21:01:46.163ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19222024-12-16T21:01:46.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19232024-12-16T21:01:46.165ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.714397ms iteration = 24 status = null
19242024-12-16T21:01:46.197ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
19252024-12-16T21:01:46.197ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19262024-12-16T21:01:46.197ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5fe7de7d-69c5-4732-b52e-55b5c6c99b12", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19272024-12-16T21:01:46.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19282024-12-16T21:01:46.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19292024-12-16T21:01:46.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19302024-12-16T21:01:46.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19312024-12-16T21:01:46.201ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19322024-12-16T21:01:46.201ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "871e985e-3cdc-45c5-8a7d-583251bce251", "content-length": "691", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19332024-12-16T21:01:46.201ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
19342024-12-16T21:01:46.201ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19352024-12-16T21:01:46.201ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19362024-12-16T21:01:46.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19372024-12-16T21:01:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19382024-12-16T21:01:46.203ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 236.796615ms iteration = 24 status = {}
19392024-12-16T21:01:46.205ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19402024-12-16T21:01:46.205ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19412024-12-16T21:01:46.205ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2cff9ffe-38bb-4615-8f6f-85b14919b943", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19422024-12-16T21:01:46.207ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 240.118018ms iteration = 25 status = {}
19432024-12-16T21:01:46.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19442024-12-16T21:01:46.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19452024-12-16T21:01:46.238ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
19462024-12-16T21:01:46.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19472024-12-16T21:01:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19482024-12-16T21:01:46.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19492024-12-16T21:01:46.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbaf13c3-281b-4603-9401-69a3d703ad7d", "content-length": "134", "date": "Mon, 16 Dec 2024 21:01:45 GMT"} })
19502024-12-16T21:01:46.245ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
19512024-12-16T21:01:46.245ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
19522024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
19532024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19542024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19552024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19562024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19572024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19582024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19592024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19602024-12-16T21:01:46.246ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
19612024-12-16T21:01:46.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19622024-12-16T21:01:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19632024-12-16T21:01:46.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19642024-12-16T21:01:46.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d317a5f8-ac2f-4af4-8a9d-6a0fc619c1b5", "content-length": "2", "date": "Mon, 16 Dec 2024 21:01:45 GMT"} })
19652024-12-16T21:01:46.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19662024-12-16T21:01:46.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "14e103f6-f01d-44f7-a9ef-bae84ab16185", "content-length": "52", "date": "Mon, 16 Dec 2024 21:01:45 GMT"} })
19672024-12-16T21:01:46.248ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
19682024-12-16T21:01:46.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19692024-12-16T21:01:46.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "55f01c04-6fe0-41c8-8e3a-05ef9f9a4538", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19702024-12-16T21:01:46.349ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
19712024-12-16T21:01:46.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19722024-12-16T21:01:46.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "26c889b3-d7fc-435c-bb07-128fabc6c070", "content-length": "682", "date": "Mon, 16 Dec 2024 21:01:46 GMT"} })
19732024-12-16T21:01:46.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19742024-12-16T21:01:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19752024-12-16T21:01:46.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19762024-12-16T21:01:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19772024-12-16T21:01:46.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19782024-12-16T21:01:46.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19792024-12-16T21:01:46.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19802024-12-16T21:01:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19812024-12-16T21:01:46.366ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 398.961693ms iteration = 24 status = {}
19822024-12-16T21:01:46.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = baddedc0-53ab-4a99-ac7e-3fe40ac24a96 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19832024-12-16T21:01:46.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = baddedc0-53ab-4a99-ac7e-3fe40ac24a96 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19842024-12-16T21:01:46.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = baddedc0-53ab-4a99-ac7e-3fe40ac24a96 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19852024-12-16T21:01:47.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 83b5680e-a267-4cde-962b-4b01871d7830 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19862024-12-16T21:01:47.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 83b5680e-a267-4cde-962b-4b01871d7830 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19872024-12-16T21:01:47.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 83b5680e-a267-4cde-962b-4b01871d7830 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19882024-12-16T21:01:47.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 31fa29ea-907e-4913-84d1-8807b2368543 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19892024-12-16T21:01:47.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 31fa29ea-907e-4913-84d1-8807b2368543 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19902024-12-16T21:01:47.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 31fa29ea-907e-4913-84d1-8807b2368543 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19912024-12-16T21:01:48.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1acc3ecd-409e-48a7-be2a-e06969e5c96c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19922024-12-16T21:01:48.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1acc3ecd-409e-48a7-be2a-e06969e5c96c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19932024-12-16T21:01:48.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1acc3ecd-409e-48a7-be2a-e06969e5c96c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19942024-12-16T21:01:49.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0bb7fbe5-f5bf-43ab-9f47-4c17781c3fea roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19952024-12-16T21:01:49.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0bb7fbe5-f5bf-43ab-9f47-4c17781c3fea resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19962024-12-16T21:01:49.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0bb7fbe5-f5bf-43ab-9f47-4c17781c3fea response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19972024-12-16T21:01:50.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ddd92f56-07d6-4652-b4c7-9669a4778e4e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19982024-12-16T21:01:50.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ddd92f56-07d6-4652-b4c7-9669a4778e4e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
19992024-12-16T21:01:50.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ddd92f56-07d6-4652-b4c7-9669a4778e4e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20002024-12-16T21:01:51.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 98cf6eab-b92c-443e-af43-0a11f0ce568b roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20012024-12-16T21:01:51.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 98cf6eab-b92c-443e-af43-0a11f0ce568b resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20022024-12-16T21:01:51.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 98cf6eab-b92c-443e-af43-0a11f0ce568b response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20032024-12-16T21:01:52.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1478 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 268e4d84-03f9-4364-a50e-e84cdfed6a2e response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
20042024-12-16T21:01:52.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9d64d9cc-e666-4c5d-af43-4b279f54195c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20052024-12-16T21:01:52.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9d64d9cc-e666-4c5d-af43-4b279f54195c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20062024-12-16T21:01:52.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9d64d9cc-e666-4c5d-af43-4b279f54195c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20072024-12-16T21:01:53.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6f3b1c52-e250-4fcf-a532-d9e160921123 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20082024-12-16T21:01:53.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6f3b1c52-e250-4fcf-a532-d9e160921123 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20092024-12-16T21:01:53.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6f3b1c52-e250-4fcf-a532-d9e160921123 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20102024-12-16T21:01:54.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a5f661bd-6e5c-4560-b990-927d70226179 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20112024-12-16T21:01:54.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a5f661bd-6e5c-4560-b990-927d70226179 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20122024-12-16T21:01:54.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a5f661bd-6e5c-4560-b990-927d70226179 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20132024-12-16T21:01:55.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6471ff6d-e8c9-463e-a75b-50f2515b2ba3 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20142024-12-16T21:01:55.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6471ff6d-e8c9-463e-a75b-50f2515b2ba3 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20152024-12-16T21:01:55.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6471ff6d-e8c9-463e-a75b-50f2515b2ba3 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20162024-12-16T21:01:55.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
20172024-12-16T21:01:55.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20182024-12-16T21:01:55.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20192024-12-16T21:01:55.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
20202024-12-16T21:01:55.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20212024-12-16T21:01:55.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20222024-12-16T21:01:55.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20232024-12-16T21:01:55.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20242024-12-16T21:01:55.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20252024-12-16T21:01:55.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20262024-12-16T21:01:55.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20272024-12-16T21:01:55.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20282024-12-16T21:01:55.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20292024-12-16T21:01:55.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
20302024-12-16T21:01:55.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20312024-12-16T21:01:55.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20322024-12-16T21:01:55.989ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
20332024-12-16T21:01:55.989ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.978289ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
20342024-12-16T21:01:55.996ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20352024-12-16T21:01:55.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20362024-12-16T21:01:55.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.565114ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20372024-12-16T21:01:56.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cb57f161-0690-48ae-9d27-ba467967e193 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20382024-12-16T21:01:56.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cb57f161-0690-48ae-9d27-ba467967e193 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20392024-12-16T21:01:56.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = cb57f161-0690-48ae-9d27-ba467967e193 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20402024-12-16T21:01:57.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 01e3a657-27d3-4301-bc78-d053ad1b11b2 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20412024-12-16T21:01:57.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 01e3a657-27d3-4301-bc78-d053ad1b11b2 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20422024-12-16T21:01:57.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 01e3a657-27d3-4301-bc78-d053ad1b11b2 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20432024-12-16T21:01:58.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e3a39bf-4297-4841-ad4f-51537319deac roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20442024-12-16T21:01:58.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e3a39bf-4297-4841-ad4f-51537319deac resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20452024-12-16T21:01:58.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e3a39bf-4297-4841-ad4f-51537319deac response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20462024-12-16T21:01:59.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 475f8894-98c4-47ae-bb32-3a75cb861e34 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20472024-12-16T21:01:59.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 475f8894-98c4-47ae-bb32-3a75cb861e34 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20482024-12-16T21:01:59.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 475f8894-98c4-47ae-bb32-3a75cb861e34 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20492024-12-16T21:02:00.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 272a28bb-5e2f-447c-9731-b6e16e6a821a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20502024-12-16T21:02:00.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 272a28bb-5e2f-447c-9731-b6e16e6a821a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20512024-12-16T21:02:00.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 272a28bb-5e2f-447c-9731-b6e16e6a821a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20522024-12-16T21:02:01.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b723997c-0897-4470-98d5-89fd3cd155b9 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20532024-12-16T21:02:01.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b723997c-0897-4470-98d5-89fd3cd155b9 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20542024-12-16T21:02:01.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b723997c-0897-4470-98d5-89fd3cd155b9 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20552024-12-16T21:02:02.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1462 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 07ce2fbb-7a7a-46fc-98b5-b30ed767b742 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
20562024-12-16T21:02:02.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e8f83ca-d5a4-4721-b2f3-1f121bf3fbbc roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20572024-12-16T21:02:02.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e8f83ca-d5a4-4721-b2f3-1f121bf3fbbc resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20582024-12-16T21:02:02.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7e8f83ca-d5a4-4721-b2f3-1f121bf3fbbc response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20592024-12-16T21:02:03.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e4fc31e5-342f-44a7-b132-761a72e1e4af roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20602024-12-16T21:02:03.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e4fc31e5-342f-44a7-b132-761a72e1e4af resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20612024-12-16T21:02:03.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e4fc31e5-342f-44a7-b132-761a72e1e4af response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20622024-12-16T21:02:05.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aef5bd70-91f1-4e76-8415-9de25b95dc85 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20632024-12-16T21:02:05.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aef5bd70-91f1-4e76-8415-9de25b95dc85 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20642024-12-16T21:02:05.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aef5bd70-91f1-4e76-8415-9de25b95dc85 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20652024-12-16T21:02:05.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
20662024-12-16T21:02:05.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20672024-12-16T21:02:05.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20682024-12-16T21:02:05.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
20692024-12-16T21:02:05.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20702024-12-16T21:02:05.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712024-12-16T21:02:05.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20722024-12-16T21:02:05.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20732024-12-16T21:02:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20742024-12-16T21:02:05.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20752024-12-16T21:02:05.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20762024-12-16T21:02:05.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20772024-12-16T21:02:05.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20782024-12-16T21:02:05.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20792024-12-16T21:02:05.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802024-12-16T21:02:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
20812024-12-16T21:02:05.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20822024-12-16T21:02:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20832024-12-16T21:02:05.988ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
20842024-12-16T21:02:05.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.692384ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
20852024-12-16T21:02:05.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.048844ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20862024-12-16T21:02:06.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8d469ab5-1a0d-4965-b3e8-5a0220b2a5d8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20872024-12-16T21:02:06.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8d469ab5-1a0d-4965-b3e8-5a0220b2a5d8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20882024-12-16T21:02:06.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8d469ab5-1a0d-4965-b3e8-5a0220b2a5d8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20892024-12-16T21:02:07.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d65e7794-1409-4eff-b9c0-499bba269893 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20902024-12-16T21:02:07.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d65e7794-1409-4eff-b9c0-499bba269893 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20912024-12-16T21:02:07.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d65e7794-1409-4eff-b9c0-499bba269893 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20922024-12-16T21:02:08.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9502a338-3226-44cf-a244-6b7629146544 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20932024-12-16T21:02:08.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9502a338-3226-44cf-a244-6b7629146544 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20942024-12-16T21:02:08.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9502a338-3226-44cf-a244-6b7629146544 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20952024-12-16T21:02:09.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 78f1e2f4-db46-4ec1-8822-e3762f41c379 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20962024-12-16T21:02:09.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 78f1e2f4-db46-4ec1-8822-e3762f41c379 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20972024-12-16T21:02:09.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 78f1e2f4-db46-4ec1-8822-e3762f41c379 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20982024-12-16T21:02:10.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c0d226e5-9eec-445f-817b-649f876a2c5a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
20992024-12-16T21:02:10.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c0d226e5-9eec-445f-817b-649f876a2c5a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21002024-12-16T21:02:10.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = c0d226e5-9eec-445f-817b-649f876a2c5a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21012024-12-16T21:02:11.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ead8a320-65b2-46cb-91ad-4107a85bc924 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21022024-12-16T21:02:11.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ead8a320-65b2-46cb-91ad-4107a85bc924 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21032024-12-16T21:02:11.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ead8a320-65b2-46cb-91ad-4107a85bc924 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21042024-12-16T21:02:12.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f9dc6422-6df0-46ba-b81f-400845269501 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21052024-12-16T21:02:12.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f9dc6422-6df0-46ba-b81f-400845269501 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21062024-12-16T21:02:12.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f9dc6422-6df0-46ba-b81f-400845269501 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21072024-12-16T21:02:12.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1467 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 1ca36cd9-be88-44e3-b7b7-987d3369294d response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
21082024-12-16T21:02:13.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6e71f150-c1c4-4fbf-808e-0416913c28b8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21092024-12-16T21:02:13.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6e71f150-c1c4-4fbf-808e-0416913c28b8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21102024-12-16T21:02:13.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6e71f150-c1c4-4fbf-808e-0416913c28b8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21112024-12-16T21:02:14.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = fd451599-4ef7-4a66-80c5-b654cd2f5b96 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21122024-12-16T21:02:14.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = fd451599-4ef7-4a66-80c5-b654cd2f5b96 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21132024-12-16T21:02:14.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = fd451599-4ef7-4a66-80c5-b654cd2f5b96 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21142024-12-16T21:02:14.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 971b9fbd-f98c-4cbf-b241-7a838f625e5f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
21152024-12-16T21:02:14.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 971b9fbd-f98c-4cbf-b241-7a838f625e5f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
21162024-12-16T21:02:14.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 971b9fbd-f98c-4cbf-b241-7a838f625e5f response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
21172024-12-16T21:02:14.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a59b6067-c0f9-477d-8abd-369488f3a32f roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21182024-12-16T21:02:14.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a59b6067-c0f9-477d-8abd-369488f3a32f resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21192024-12-16T21:02:14.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = a59b6067-c0f9-477d-8abd-369488f3a32f response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21202024-12-16T21:02:15.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2109db4d-521c-4c45-b699-fccac78fdbe9 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21212024-12-16T21:02:15.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2109db4d-521c-4c45-b699-fccac78fdbe9 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21222024-12-16T21:02:15.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2109db4d-521c-4c45-b699-fccac78fdbe9 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
21232024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
21242024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
21252024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21262024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
21272024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
21282024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21292024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
21302024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
21312024-12-16T21:02:15.966ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21322024-12-16T21:02:15.966ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-16 20:52:15.966714553 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21332024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21342024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
21352024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21362024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
21372024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21382024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21392024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
21402024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21412024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
21422024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21432024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
21442024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
21452024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21462024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21472024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21482024-12-16T21:02:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
21492024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21502024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21512024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21522024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21532024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21542024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21552024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21562024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21572024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21582024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21592024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21602024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21612024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21622024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21632024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21642024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21652024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21662024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21672024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
21682024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
21692024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21702024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
21712024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21722024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
21732024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21742024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
21752024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21762024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
21772024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21782024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
21792024-12-16T21:02:15.967ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21802024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21812024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
21822024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21832024-12-16T21:02:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21842024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
21852024-12-16T21:02:15.968ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546
21862024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
21872024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21882024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.981\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546"}
21892024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
21902024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21912024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
21922024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
21932024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21942024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21952024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
21962024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21972024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
21982024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21992024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
22002024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22012024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
22022024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22032024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
22042024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22052024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22062024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22072024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22082024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22092024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22102024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22112024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22122024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22132024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22142024-12-16T21:02:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2119cbc5-42cf-405b-af5a-3fb6ae08bc7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 498951073 } })
22152024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22162024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22172024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22182024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22192024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22202024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22212024-12-16T21:02:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2bad804c-125d-4b4f-bbb4-08849c8bee33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e73705b-19c3-4191-883c-2bba82160d3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 499139757 } })
22222024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
22232024-12-16T21:02:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 963.488\u{b5}s iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
22242024-12-16T21:02:15.969ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
22252024-12-16T21:02:15.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.151482ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
22262024-12-16T21:02:15.969ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 500326750 } })
22272024-12-16T21:02:15.970ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
22282024-12-16T21:02:15.970ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 500590935 } })
22292024-12-16T21:02:15.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.589108ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22302024-12-16T21:02:15.970ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22312024-12-16T21:02:15.970ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
22322024-12-16T21:02:15.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22332024-12-16T21:02:15.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22342024-12-16T21:02:15.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22352024-12-16T21:02:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22362024-12-16T21:02:15.973ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22372024-12-16T21:02:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22382024-12-16T21:02:15.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22392024-12-16T21:02:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22402024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22412024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22422024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22432024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22442024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22452024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22462024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22472024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22482024-12-16T21:02:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22492024-12-16T21:02:15.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22502024-12-16T21:02:15.979ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-16 20:52:15.966714553 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22512024-12-16T21:02:15.979ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.328246ms iteration = 13 status = {"expiration":"2024-12-16T20:52:15.966714553Z","pruned":[]}
22522024-12-16T21:02:15.980ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22532024-12-16T21:02:15.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22542024-12-16T21:02:15.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22552024-12-16T21:02:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22562024-12-16T21:02:15.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22572024-12-16T21:02:15.983ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22582024-12-16T21:02:15.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22592024-12-16T21:02:15.983ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602024-12-16T21:02:15.984ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
22612024-12-16T21:02:15.984ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
22622024-12-16T21:02:15.984ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.563806ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
22632024-12-16T21:02:15.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22642024-12-16T21:02:15.985ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22652024-12-16T21:02:15.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22662024-12-16T21:02:15.985ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22672024-12-16T21:02:15.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22682024-12-16T21:02:15.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22692024-12-16T21:02:15.987ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22702024-12-16T21:02:15.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22712024-12-16T21:02:15.987ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22722024-12-16T21:02:15.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22732024-12-16T21:02:15.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22742024-12-16T21:02:15.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22752024-12-16T21:02:15.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22762024-12-16T21:02:15.989ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22772024-12-16T21:02:15.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22782024-12-16T21:02:15.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22792024-12-16T21:02:15.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22802024-12-16T21:02:15.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22812024-12-16T21:02:15.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22822024-12-16T21:02:15.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22832024-12-16T21:02:15.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22842024-12-16T21:02:15.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22852024-12-16T21:02:15.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22862024-12-16T21:02:15.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22872024-12-16T21:02:15.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22882024-12-16T21:02:15.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22892024-12-16T21:02:15.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22902024-12-16T21:02:15.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 28.648787ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
22912024-12-16T21:02:15.998ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.109165ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
22922024-12-16T21:02:15.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22932024-12-16T21:02:15.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22942024-12-16T21:02:15.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22952024-12-16T21:02:16.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22962024-12-16T21:02:16.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22972024-12-16T21:02:16.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22982024-12-16T21:02:16.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22992024-12-16T21:02:16.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23002024-12-16T21:02:16.005ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012024-12-16T21:02:16.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23022024-12-16T21:02:16.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23032024-12-16T21:02:16.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23042024-12-16T21:02:16.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23052024-12-16T21:02:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23062024-12-16T21:02:16.009ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23072024-12-16T21:02:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23082024-12-16T21:02:16.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23092024-12-16T21:02:16.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.598493ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23102024-12-16T21:02:16.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23112024-12-16T21:02:16.013ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1864, tv_nsec: 543873742 } })
23122024-12-16T21:02:16.013ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
23132024-12-16T21:02:16.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23142024-12-16T21:02:16.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23152024-12-16T21:02:16.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23162024-12-16T21:02:16.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23172024-12-16T21:02:16.017ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23182024-12-16T21:02:16.017ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23192024-12-16T21:02:16.017ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23202024-12-16T21:02:16.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23212024-12-16T21:02:16.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23222024-12-16T21:02:16.018ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 52.019504ms iteration = 6 status = {"nsuccess":5}
23232024-12-16T21:02:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23242024-12-16T21:02:16.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23252024-12-16T21:02:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23262024-12-16T21:02:16.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23272024-12-16T21:02:16.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23282024-12-16T21:02:16.025ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23292024-12-16T21:02:16.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23302024-12-16T21:02:16.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23312024-12-16T21:02:16.028ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.543957ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23322024-12-16T21:02:16.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23332024-12-16T21:02:16.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23342024-12-16T21:02:16.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23352024-12-16T21:02:16.029ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.830252ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
23362024-12-16T21:02:16.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23372024-12-16T21:02:16.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23382024-12-16T21:02:16.033ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23392024-12-16T21:02:16.033ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23402024-12-16T21:02:16.033ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.852067ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23412024-12-16T21:02:16.036ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23422024-12-16T21:02:16.036ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23432024-12-16T21:02:16.036ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23442024-12-16T21:02:16.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23452024-12-16T21:02:16.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23462024-12-16T21:02:16.041ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-16T20:50:11.628239Z, time_modified: 2024-12-16T20:50:11.628239Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
23472024-12-16T21:02:16.041ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 74.435343ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]}},"default_endpoint":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23482024-12-16T21:02:16.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23492024-12-16T21:02:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23502024-12-16T21:02:16.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23512024-12-16T21:02:16.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23522024-12-16T21:02:16.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23532024-12-16T21:02:16.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23542024-12-16T21:02:16.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.913199ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23552024-12-16T21:02:16.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23562024-12-16T21:02:16.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23572024-12-16T21:02:16.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23582024-12-16T21:02:16.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
23592024-12-16T21:02:16.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23602024-12-16T21:02:16.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23612024-12-16T21:02:16.055ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.115733ms iteration = 25 status = 0
23622024-12-16T21:02:16.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23632024-12-16T21:02:16.056ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23642024-12-16T21:02:16.056ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23652024-12-16T21:02:16.056ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23662024-12-16T21:02:16.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23672024-12-16T21:02:16.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23682024-12-16T21:02:16.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692024-12-16T21:02:16.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23702024-12-16T21:02:16.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23712024-12-16T21:02:16.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23722024-12-16T21:02:16.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23732024-12-16T21:02:16.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23742024-12-16T21:02:16.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23752024-12-16T21:02:16.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23762024-12-16T21:02:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
23772024-12-16T21:02:16.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23782024-12-16T21:02:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23792024-12-16T21:02:16.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23802024-12-16T21:02:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23812024-12-16T21:02:16.067ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23822024-12-16T21:02:16.067ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23832024-12-16T21:02:16.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23842024-12-16T21:02:16.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23852024-12-16T21:02:16.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.498544ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23862024-12-16T21:02:16.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872024-12-16T21:02:16.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23882024-12-16T21:02:16.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23892024-12-16T21:02:16.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23902024-12-16T21:02:16.100ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 133.49669ms iteration = 29 status = {"physical_disks_added":0}
23912024-12-16T21:02:16.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23922024-12-16T21:02:16.117ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23932024-12-16T21:02:16.117ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "956a0c85-860e-4954-b133-471f319aece4", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
23942024-12-16T21:02:16.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23952024-12-16T21:02:16.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23962024-12-16T21:02:16.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23972024-12-16T21:02:16.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23982024-12-16T21:02:16.153ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23992024-12-16T21:02:16.153ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24002024-12-16T21:02:16.153ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba80cad-c546-465e-b9ad-7b580ea45794", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
24012024-12-16T21:02:16.153ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24022024-12-16T21:02:16.155ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24032024-12-16T21:02:16.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24042024-12-16T21:02:16.229ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24052024-12-16T21:02:16.257ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/509c6491-01b0-4a11-b979-5fc7a21d9623/state
24062024-12-16T21:02:16.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 740f9f25-4fb1-40f4-8d53-1fb295b6e711 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
24072024-12-16T21:02:16.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 740f9f25-4fb1-40f4-8d53-1fb295b6e711 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
24082024-12-16T21:02:16.295ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24092024-12-16T21:02:16.295ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24102024-12-16T21:02:16.296ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf2faf35-4002-4736-8203-086c8a61fb84", "content-length": "523", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
24112024-12-16T21:02:16.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24122024-12-16T21:02:16.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24132024-12-16T21:02:16.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24142024-12-16T21:02:16.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24152024-12-16T21:02:16.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24162024-12-16T21:02:16.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24172024-12-16T21:02:16.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 740f9f25-4fb1-40f4-8d53-1fb295b6e711 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
24182024-12-16T21:02:16.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24192024-12-16T21:02:16.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24202024-12-16T21:02:16.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24212024-12-16T21:02:16.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24222024-12-16T21:02:16.354ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d098904b-f205-4d2c-88a1-a8808b206d59: {10.151.2.176: {d7e19738-b63c-450f-913c-442e8f09026d}, 10.151.2.175: {d7e19738-b63c-450f-913c-442e8f09026d}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
24232024-12-16T21:02:16.354ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24242024-12-16T21:02:16.354ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24252024-12-16T21:02:16.354ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24262024-12-16T21:02:16.354ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 386.118478ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24272024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24282024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 0 version = 2
24292024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24302024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "edfd64f7-3f9e-46c6-bc82-cb44ab7d506a", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
24312024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24322024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24332024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
24342024-12-16T21:02:16.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 404.53547ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
24352024-12-16T21:02:16.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24362024-12-16T21:02:16.377ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24372024-12-16T21:02:16.377ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24382024-12-16T21:02:16.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24392024-12-16T21:02:16.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24402024-12-16T21:02:16.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24412024-12-16T21:02:16.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24422024-12-16T21:02:16.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24432024-12-16T21:02:16.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24442024-12-16T21:02:16.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24452024-12-16T21:02:16.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24462024-12-16T21:02:16.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24472024-12-16T21:02:16.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24482024-12-16T21:02:16.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24492024-12-16T21:02:16.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24502024-12-16T21:02:16.433ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24512024-12-16T21:02:16.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24522024-12-16T21:02:16.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24532024-12-16T21:02:16.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24542024-12-16T21:02:16.438ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24552024-12-16T21:02:16.438ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 470.679654ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24562024-12-16T21:02:16.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24572024-12-16T21:02:16.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24582024-12-16T21:02:16.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24592024-12-16T21:02:16.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24602024-12-16T21:02:16.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24612024-12-16T21:02:16.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24622024-12-16T21:02:16.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24632024-12-16T21:02:16.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24642024-12-16T21:02:16.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24652024-12-16T21:02:16.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662024-12-16T21:02:16.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24672024-12-16T21:02:16.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24682024-12-16T21:02:16.462ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24692024-12-16T21:02:16.462ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24702024-12-16T21:02:16.462ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-16 20:50:36.066577 UTC dns_group = internal generation = 1
24712024-12-16T21:02:16.462ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 495.450326ms iteration = 14 status = {"generation":1}
24722024-12-16T21:02:16.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24732024-12-16T21:02:16.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24742024-12-16T21:02:16.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24752024-12-16T21:02:16.472ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24762024-12-16T21:02:16.472ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba562a6b-8871-4d5d-90be-69eeba850e80", "content-length": "1", "date": "Mon, 16 Dec 2024 21:02:15 GMT"} })
24772024-12-16T21:02:16.474ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 1 version = 2
24782024-12-16T21:02:16.474ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24792024-12-16T21:02:16.474ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-16 20:50:36.849175 UTC dns_group = external generation = 2
24802024-12-16T21:02:16.474ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 506.707382ms iteration = 14 status = {"generation":2}
24812024-12-16T21:02:16.474ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24822024-12-16T21:02:16.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24832024-12-16T21:02:16.477ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 510.536845ms iteration = 25 status = null
24842024-12-16T21:02:16.494ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
24852024-12-16T21:02:16.494ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24862024-12-16T21:02:16.494ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83146eeb-1ba7-417c-b3da-6dfa1474abec", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
24872024-12-16T21:02:16.494ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24882024-12-16T21:02:16.497ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
24892024-12-16T21:02:16.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24902024-12-16T21:02:16.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24912024-12-16T21:02:16.523ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 557.185156ms iteration = 25 status = {}
24922024-12-16T21:02:16.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24932024-12-16T21:02:16.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24942024-12-16T21:02:16.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24952024-12-16T21:02:16.551ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8ff12323-2d01-4a77-84a6-66ca293f05f0", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24962024-12-16T21:02:16.551ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24972024-12-16T21:02:16.554ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7d141ce4-8063-4cd2-b62d-2128cfcc4e8e", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24982024-12-16T21:02:16.554ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24992024-12-16T21:02:16.555ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25002024-12-16T21:02:16.555ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 588.832221ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25012024-12-16T21:02:16.566ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25022024-12-16T21:02:16.654ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25032024-12-16T21:02:16.655ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "342438f6-29c9-4dab-b66b-560c3c86f77b", "content-length": "810", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
25042024-12-16T21:02:16.655ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(4244456) }} sled = sock
25052024-12-16T21:02:16.655ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25062024-12-16T21:02:16.655ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25072024-12-16T21:02:16.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25082024-12-16T21:02:16.657ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 689.320931ms iteration = 25 status = {}
25092024-12-16T21:02:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 05eacb6d-fd36-4c61-b029-f4638df252aa, lookup_type: ById(05eacb6d-fd36-4c61-b029-f4638df252aa) }, key: 9e00c948-4ce2-404a-a4ee-931ff2383a2f, lookup_type: ById(9e00c948-4ce2-404a-a4ee-931ff2383a2f) } result = Ok(())
25102024-12-16T21:02:16.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25112024-12-16T21:02:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25122024-12-16T21:02:16.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25132024-12-16T21:02:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25142024-12-16T21:02:16.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25152024-12-16T21:02:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25162024-12-16T21:02:16.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25172024-12-16T21:02:16.670ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25182024-12-16T21:02:16.670ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0dcd6ac8-99b4-4038-9842-570b71784e61", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25192024-12-16T21:02:16.670ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25202024-12-16T21:02:16.671ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1957ecf3-b984-45c8-a1b0-4c73480439b4", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25212024-12-16T21:02:16.671ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25222024-12-16T21:02:16.672ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 05eacb6d-fd36-4c61-b029-f4638df252aa, lookup_type: ById(05eacb6d-fd36-4c61-b029-f4638df252aa) }, key: 9e00c948-4ce2-404a-a4ee-931ff2383a2f, lookup_type: ById(9e00c948-4ce2-404a-a4ee-931ff2383a2f) } result = Ok(())
25232024-12-16T21:02:16.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25242024-12-16T21:02:16.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25252024-12-16T21:02:16.674ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "526fc01e-0852-4c7e-9e65-258259b6e651", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25262024-12-16T21:02:16.674ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25272024-12-16T21:02:16.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25282024-12-16T21:02:16.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25292024-12-16T21:02:16.676ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25302024-12-16T21:02:16.676ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 709.847813ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25312024-12-16T21:02:16.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25322024-12-16T21:02:16.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25332024-12-16T21:02:16.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25342024-12-16T21:02:16.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25352024-12-16T21:02:16.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25362024-12-16T21:02:16.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25372024-12-16T21:02:16.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25382024-12-16T21:02:16.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25392024-12-16T21:02:16.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25402024-12-16T21:02:16.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25412024-12-16T21:02:16.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25422024-12-16T21:02:16.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25432024-12-16T21:02:16.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442024-12-16T21:02:16.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 05eacb6d-fd36-4c61-b029-f4638df252aa, lookup_type: ById(05eacb6d-fd36-4c61-b029-f4638df252aa) }, key: 3e9a7262-9111-4cee-9160-1d44bb8e5259, lookup_type: ByName("default") } result = Ok(())
25452024-12-16T21:02:16.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25462024-12-16T21:02:16.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25472024-12-16T21:02:16.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25482024-12-16T21:02:16.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25492024-12-16T21:02:16.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25502024-12-16T21:02:16.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25512024-12-16T21:02:16.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25522024-12-16T21:02:16.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25532024-12-16T21:02:16.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25542024-12-16T21:02:16.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25552024-12-16T21:02:16.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25562024-12-16T21:02:16.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25572024-12-16T21:02:16.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-12-16T21:02:16.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25592024-12-16T21:02:16.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602024-12-16T21:02:16.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 05eacb6d-fd36-4c61-b029-f4638df252aa, lookup_type: ById(05eacb6d-fd36-4c61-b029-f4638df252aa) }, key: d7e19738-b63c-450f-913c-442e8f09026d, lookup_type: ByName("default") } result = Ok(())
25612024-12-16T21:02:16.715ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25622024-12-16T21:02:16.716ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c03ff94-7e07-46ed-b0ed-55079133fb74", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
25632024-12-16T21:02:16.718ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 750.786605ms iteration = 26 status = {}
25642024-12-16T21:02:16.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25652024-12-16T21:02:16.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25662024-12-16T21:02:16.745ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
25672024-12-16T21:02:16.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25682024-12-16T21:02:16.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25692024-12-16T21:02:16.758ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25702024-12-16T21:02:16.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f65d9f20-46d3-4173-831e-f5c69c22f2cc", "content-length": "134", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
25712024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25722024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
25732024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25742024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25752024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25762024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25772024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25782024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25792024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25802024-12-16T21:02:16.759ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25812024-12-16T21:02:16.760ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
25822024-12-16T21:02:16.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25832024-12-16T21:02:16.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25842024-12-16T21:02:16.762ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25852024-12-16T21:02:16.762ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "79be6e3a-bf76-4778-a2fe-4d39d61541d9", "content-length": "2", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
25862024-12-16T21:02:16.762ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25872024-12-16T21:02:16.762ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8508ded9-65c5-4726-8501-084ac3d171fc", "content-length": "52", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
25882024-12-16T21:02:16.763ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
25892024-12-16T21:02:16.763ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25902024-12-16T21:02:16.911ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3845b24d-a8b0-4f71-b37b-1e53ed7ee024", "date": "Mon, 16 Dec 2024 21:02:16 GMT"} })
25912024-12-16T21:02:16.911ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
25922024-12-16T21:02:16.911ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25932024-12-16T21:02:17.048ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9024937-fe2c-4042-ad76-174d0e519c8d", "content-length": "682", "date": "Mon, 16 Dec 2024 21:02:17 GMT"} })
25942024-12-16T21:02:17.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25952024-12-16T21:02:17.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25962024-12-16T21:02:17.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25972024-12-16T21:02:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25982024-12-16T21:02:17.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25992024-12-16T21:02:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26002024-12-16T21:02:17.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26012024-12-16T21:02:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26022024-12-16T21:02:17.073ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.105279148s iteration = 25 status = {}
26032024-12-16T21:02:17.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2a3d537e-3cf8-47c2-a2f3-156359c0a351 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26042024-12-16T21:02:17.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2a3d537e-3cf8-47c2-a2f3-156359c0a351 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26052024-12-16T21:02:17.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2a3d537e-3cf8-47c2-a2f3-156359c0a351 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26062024-12-16T21:02:18.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 703fcb39-c37b-49f3-9943-da4cfe966c57 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26072024-12-16T21:02:18.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 703fcb39-c37b-49f3-9943-da4cfe966c57 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26082024-12-16T21:02:18.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 703fcb39-c37b-49f3-9943-da4cfe966c57 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26092024-12-16T21:02:19.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 273a427c-fe5e-48d9-853f-8bfc299df0c2 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26102024-12-16T21:02:19.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 273a427c-fe5e-48d9-853f-8bfc299df0c2 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26112024-12-16T21:02:19.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 273a427c-fe5e-48d9-853f-8bfc299df0c2 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26122024-12-16T21:02:20.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 910983f5-7970-4b27-b60f-88a537d4cc1e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26132024-12-16T21:02:20.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 910983f5-7970-4b27-b60f-88a537d4cc1e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26142024-12-16T21:02:20.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 910983f5-7970-4b27-b60f-88a537d4cc1e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26152024-12-16T21:02:21.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ee7859eb-ff65-4145-9b0b-7545e4cf06aa roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26162024-12-16T21:02:21.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ee7859eb-ff65-4145-9b0b-7545e4cf06aa resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26172024-12-16T21:02:21.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ee7859eb-ff65-4145-9b0b-7545e4cf06aa response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26182024-12-16T21:02:22.187ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1387 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 511d5c52-b7b8-4328-a32d-53fe308cb48b response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
26192024-12-16T21:02:22.461ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/509c6491-01b0-4a11-b979-5fc7a21d9623/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bd0381e-eabb-4213-a370-7c554ecb4831", "content-length": "131", "date": "Mon, 16 Dec 2024 21:02:22 GMT"} })
26202024-12-16T21:02:22.461ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 sled_id = fcb8d596-df56-4771-9db0-b88ea87e1f94 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-16T21:02:14.220502469Z }, migration_in: None, migration_out: None } vmm_id = 509c6491-01b0-4a11-b979-5fc7a21d9623
26212024-12-16T21:02:22.461ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 sled_id = fcb8d596-df56-4771-9db0-b88ea87e1f94 vmm_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-16T21:02:14.220502469Z }
26222024-12-16T21:02:22.461ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 roles = RoleSet { roles: {} } sled_id = fcb8d596-df56-4771-9db0-b88ea87e1f94 vmm_id = 509c6491-01b0-4a11-b979-5fc7a21d9623
26232024-12-16T21:02:22.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 resource = Database result = Ok(()) sled_id = fcb8d596-df56-4771-9db0-b88ea87e1f94 vmm_id = 509c6491-01b0-4a11-b979-5fc7a21d9623
26242024-12-16T21:02:22.470ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
26252024-12-16T21:02:22.472ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.504625462s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
26262024-12-16T21:02:22.473ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f49e215a-7e8d-40fe-8b6e-26bd07efdf4e uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-16T21:02:22.465216118Z }
26272024-12-16T21:02:22.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f49e215a-7e8d-40fe-8b6e-26bd07efdf4e roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26282024-12-16T21:02:22.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f49e215a-7e8d-40fe-8b6e-26bd07efdf4e resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26292024-12-16T21:02:22.499ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:37052
26302024-12-16T21:02:22.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:37052 req_id = 2e10164e-5c66-4944-9253-ab3f7d951dd3 roles = RoleSet { roles: {} } uri = /metrics/producers
26312024-12-16T21:02:22.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:37052 req_id = 2e10164e-5c66-4944-9253-ab3f7d951dd3 resource = Database result = Ok(()) uri = /metrics/producers
26322024-12-16T21:02:22.504ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:40980
26332024-12-16T21:02:22.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40980 req_id = 023c2d1c-f99e-4fab-bbfe-f4bff7ff08ba roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26342024-12-16T21:02:22.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40980 req_id = 023c2d1c-f99e-4fab-bbfe-f4bff7ff08ba resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26352024-12-16T21:02:22.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40980 req_id = 023c2d1c-f99e-4fab-bbfe-f4bff7ff08ba response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26362024-12-16T21:02:22.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52898 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f49e215a-7e8d-40fe-8b6e-26bd07efdf4e response_code = 204 uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26372024-12-16T21:02:22.518ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac770bf1-32c4-487f-9976-2d5e7143d598 uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-16T21:02:22.518730120Z }
26382024-12-16T21:02:22.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac770bf1-32c4-487f-9976-2d5e7143d598 roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26392024-12-16T21:02:22.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac770bf1-32c4-487f-9976-2d5e7143d598 resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26402024-12-16T21:02:22.542ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8
26412024-12-16T21:02:22.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43021 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:37052 req_id = 2e10164e-5c66-4944-9253-ab3f7d951dd3 response_code = 201 uri = /metrics/producers
26422024-12-16T21:02:22.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44144 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ac770bf1-32c4-487f-9976-2d5e7143d598 response_code = 204 uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26432024-12-16T21:02:23.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bd224958-bdc4-4d52-9cec-50aa47860d30 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26442024-12-16T21:02:23.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bd224958-bdc4-4d52-9cec-50aa47860d30 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26452024-12-16T21:02:23.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bd224958-bdc4-4d52-9cec-50aa47860d30 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26462024-12-16T21:02:24.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1ad4eefc-4b88-4a06-80c4-9ac646b54a1b roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26472024-12-16T21:02:24.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1ad4eefc-4b88-4a06-80c4-9ac646b54a1b resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26482024-12-16T21:02:24.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1ad4eefc-4b88-4a06-80c4-9ac646b54a1b response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26492024-12-16T21:02:25.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 008e71a9-9403-4774-be02-61768184819d roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26502024-12-16T21:02:25.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 008e71a9-9403-4774-be02-61768184819d resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26512024-12-16T21:02:25.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 008e71a9-9403-4774-be02-61768184819d response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26522024-12-16T21:02:25.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
26532024-12-16T21:02:25.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26542024-12-16T21:02:25.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26552024-12-16T21:02:25.966ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
26562024-12-16T21:02:25.966ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26572024-12-16T21:02:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26582024-12-16T21:02:25.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26592024-12-16T21:02:25.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26602024-12-16T21:02:25.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26612024-12-16T21:02:25.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26622024-12-16T21:02:25.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26632024-12-16T21:02:25.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26642024-12-16T21:02:25.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26652024-12-16T21:02:25.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
26662024-12-16T21:02:25.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26672024-12-16T21:02:25.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26682024-12-16T21:02:25.994ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
26692024-12-16T21:02:25.994ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.24837ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
26702024-12-16T21:02:25.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26712024-12-16T21:02:25.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26722024-12-16T21:02:26.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.832138ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26732024-12-16T21:02:26.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e7c32dd1-3ac2-4d72-899d-4e571ec33b5e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26742024-12-16T21:02:26.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e7c32dd1-3ac2-4d72-899d-4e571ec33b5e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26752024-12-16T21:02:26.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e7c32dd1-3ac2-4d72-899d-4e571ec33b5e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26762024-12-16T21:02:27.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 969ede1f-75a6-4211-bd7d-f6d64bc7cf29 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26772024-12-16T21:02:27.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 969ede1f-75a6-4211-bd7d-f6d64bc7cf29 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26782024-12-16T21:02:27.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 969ede1f-75a6-4211-bd7d-f6d64bc7cf29 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26792024-12-16T21:02:28.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d2c83873-4b86-41a1-baea-df2a22fac692 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26802024-12-16T21:02:28.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d2c83873-4b86-41a1-baea-df2a22fac692 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26812024-12-16T21:02:28.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d2c83873-4b86-41a1-baea-df2a22fac692 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26822024-12-16T21:02:29.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 19354dca-8ba1-41ae-bb99-3a33aedd2e9c roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26832024-12-16T21:02:29.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 19354dca-8ba1-41ae-bb99-3a33aedd2e9c resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26842024-12-16T21:02:29.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 19354dca-8ba1-41ae-bb99-3a33aedd2e9c response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26852024-12-16T21:02:30.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 68de07c5-5ae4-4563-a2d7-ce70399605b1 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26862024-12-16T21:02:30.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 68de07c5-5ae4-4563-a2d7-ce70399605b1 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26872024-12-16T21:02:30.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 68de07c5-5ae4-4563-a2d7-ce70399605b1 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26882024-12-16T21:02:31.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1308eff4-f7a8-4df6-bb15-a5e3c38c28a1 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26892024-12-16T21:02:31.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1308eff4-f7a8-4df6-bb15-a5e3c38c28a1 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26902024-12-16T21:02:31.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1308eff4-f7a8-4df6-bb15-a5e3c38c28a1 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26912024-12-16T21:02:31.890ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 remote_addr = [fd00:1122:3344:101::1]:35687 req_id = facaccff-ed4f-4c45-a48e-1b7fd174b89f uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-16T21:02:31.890219629Z }
26922024-12-16T21:02:31.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = facaccff-ed4f-4c45-a48e-1b7fd174b89f roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26932024-12-16T21:02:31.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = facaccff-ed4f-4c45-a48e-1b7fd174b89f resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26942024-12-16T21:02:31.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40150 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = facaccff-ed4f-4c45-a48e-1b7fd174b89f response_code = 204 uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
26952024-12-16T21:02:32.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4646 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 2c197905-6140-405a-beee-5ef30f07629a response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
26962024-12-16T21:02:32.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 48213b03-bd9c-4a25-8483-bd40d185ffe0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26972024-12-16T21:02:32.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 48213b03-bd9c-4a25-8483-bd40d185ffe0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26982024-12-16T21:02:32.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 48213b03-bd9c-4a25-8483-bd40d185ffe0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
26992024-12-16T21:02:33.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = efe3627b-4a43-4399-aef0-32b293335848 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
27002024-12-16T21:02:33.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = efe3627b-4a43-4399-aef0-32b293335848 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
27012024-12-16T21:02:33.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = efe3627b-4a43-4399-aef0-32b293335848 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
27022024-12-16T21:02:33.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = def9e176-a58e-4671-8a85-70b88f820108 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
27032024-12-16T21:02:33.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = def9e176-a58e-4671-8a85-70b88f820108 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
27042024-12-16T21:02:33.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = def9e176-a58e-4671-8a85-70b88f820108 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
27052024-12-16T21:02:33.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e0802fe8-4f55-494f-bfbf-f7c44106b23f roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
27062024-12-16T21:02:33.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e0802fe8-4f55-494f-bfbf-f7c44106b23f resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
27072024-12-16T21:02:33.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e0802fe8-4f55-494f-bfbf-f7c44106b23f response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
27082024-12-16T21:02:34.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 6c1bae33-6bc5-4025-a63c-02145ec3d52c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
27092024-12-16T21:02:34.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 6c1bae33-6bc5-4025-a63c-02145ec3d52c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
27102024-12-16T21:02:34.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 6c1bae33-6bc5-4025-a63c-02145ec3d52c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
27112024-12-16T21:02:34.381ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-16T21:02:34.380853496Z }
27122024-12-16T21:02:34.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27132024-12-16T21:02:34.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27142024-12-16T21:02:34.389ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_needs_update = true
27152024-12-16T21:02:34.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27162024-12-16T21:02:34.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27172024-12-16T21:02:34.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27182024-12-16T21:02:34.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27192024-12-16T21:02:34.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27202024-12-16T21:02:34.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27212024-12-16T21:02:34.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27222024-12-16T21:02:34.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27232024-12-16T21:02:34.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27242024-12-16T21:02:34.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27252024-12-16T21:02:34.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27262024-12-16T21:02:34.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27272024-12-16T21:02:34.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27282024-12-16T21:02:34.404ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 4e413624-9cb3-4b0b-9b33-4dc7141193b8, lookup_type: ById(4e413624-9cb3-4b0b-9b33-4dc7141193b8) } result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27292024-12-16T21:02:34.404ZINFOnexus (dropshot_internal): starting update saga for 4e413624-9cb3-4b0b-9b33-4dc7141193b8 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-16T21:02:34.380853496Z }
27302024-12-16T21:02:34.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23629 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf response_code = 204 uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27312024-12-16T21:02:34.404ZDEBGnexus (dropshot_internal): preparing instance-update saga for 4e413624-9cb3-4b0b-9b33-4dc7141193b8... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 276e7888-db46-48f5-8dfc-378a037b96cf uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27322024-12-16T21:02:34.404ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update
27332024-12-16T21:02:34.404ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"4e413624-9cb3-4b0b-9b33-4dc7141193b8","lookup_type":{"ById":"4e413624-9cb3-4b0b-9b33-4dc7141193b8"},"parent":{"key":"78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed","lookup_type":{"ById":"78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed"},"parent":{"key":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","lookup_type":{"ById":"4496ac4b-bda9-4b4f-a09a-c65109be50f4"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27342024-12-16T21:02:34.404ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update
27352024-12-16T21:02:34.405ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e1cc8d1a-1751-4929-8518-8d8d21c6196e uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-16T21:02:34.380853496Z }
27362024-12-16T21:02:34.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e1cc8d1a-1751-4929-8518-8d8d21c6196e roles = RoleSet { roles: {} } uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27372024-12-16T21:02:34.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e1cc8d1a-1751-4929-8518-8d8d21c6196e resource = Database result = Ok(()) uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27382024-12-16T21:02:34.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4252 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e1cc8d1a-1751-4929-8518-8d8d21c6196e response_code = 204 uri = /vmms/509c6491-01b0-4a11-b979-5fc7a21d9623
27392024-12-16T21:02:34.435ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update
27402024-12-16T21:02:34.435ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27412024-12-16T21:02:34.435ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27422024-12-16T21:02:34.435ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27432024-12-16T21:02:34.439ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27442024-12-16T21:02:34.440ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27452024-12-16T21:02:34.442ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27462024-12-16T21:02:34.442ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27472024-12-16T21:02:34.446ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27482024-12-16T21:02:34.446ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122")) node_id = 0 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27492024-12-16T21:02:34.449ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27502024-12-16T21:02:34.449ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27512024-12-16T21:02:34.455ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update
27522024-12-16T21:02:34.455ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27532024-12-16T21:02:34.455ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27542024-12-16T21:02:34.458ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27552024-12-16T21:02:34.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27562024-12-16T21:02:34.459ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27572024-12-16T21:02:34.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27582024-12-16T21:02:34.461ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27592024-12-16T21:02:34.461ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27602024-12-16T21:02:34.463ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27612024-12-16T21:02:34.463ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27622024-12-16T21:02:34.464ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27632024-12-16T21:02:34.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27642024-12-16T21:02:34.465ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27652024-12-16T21:02:34.469ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 4e413624-9cb3-4b0b-9b33-4dc7141193b8, lookup_type: ById(4e413624-9cb3-4b0b-9b33-4dc7141193b8) } result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27662024-12-16T21:02:34.469ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance updater_id = d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122
27672024-12-16T21:02:34.469ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27682024-12-16T21:02:34.469ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27692024-12-16T21:02:34.477ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance updater_id = d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122
27702024-12-16T21:02:34.477ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27712024-12-16T21:02:34.478ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance
27722024-12-16T21:02:34.482ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 locked_gen = Generation(Generation(2)) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = LockInstance updater_id = d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122
27732024-12-16T21:02:34.484ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27742024-12-16T21:02:34.484ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122")}) node_id = 1 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27752024-12-16T21:02:34.488ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27762024-12-16T21:02:34.488ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
27772024-12-16T21:02:34.491ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27782024-12-16T21:02:34.491ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27792024-12-16T21:02:34.492ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27802024-12-16T21:02:34.493ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27812024-12-16T21:02:34.494ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27822024-12-16T21:02:34.494ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27832024-12-16T21:02:34.496ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27842024-12-16T21:02:34.499ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 4e413624-9cb3-4b0b-9b33-4dc7141193b8, lookup_type: ById(4e413624-9cb3-4b0b-9b33-4dc7141193b8) } result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27852024-12-16T21:02:34.499ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27862024-12-16T21:02:34.499ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27872024-12-16T21:02:34.504ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 509c6491-01b0-4a11-b979-5fc7a21d9623, time_created: 2024-12-16T21:02:13.615571Z, time_deleted: None, instance_id: 4e413624-9cb3-4b0b-9b33-4dc7141193b8, sled_id: fcb8d596-df56-4771-9db0-b88ea87e1f94, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-16T21:02:34.380853Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-16T21:02:10.494611Z, gen: Generation(Generation(3)), propolis_id: Some(509c6491-01b0-4a11-b979-5fc7a21d9623), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(509c6491-01b0-4a11-b979-5fc7a21d9623 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-16T21:02:34.504766814Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
27882024-12-16T21:02:34.512ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
27892024-12-16T21:02:34.512ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"4e413624-9cb3-4b0b-9b33-4dc7141193b8","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"509c6491-01b0-4a11-b979-5fc7a21d9623"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"4e413624-9cb3-4b0b-9b33-4dc7141193b8","lookup_type":{"ById":"4e413624-9cb3-4b0b-9b33-4dc7141193b8"},"parent":{"key":"78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed","lookup_type":{"ById":"78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed"},"parent":{"key":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","lookup_type":{"ById":"4496ac4b-bda9-4b4f-a09a-c65109be50f4"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed","ram_diff":1073741824},"destroy_active_vmm":"509c6491-01b0-4a11-b979-5fc7a21d9623","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-16T21:02:34.504766814Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27902024-12-16T21:02:34.512ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
27912024-12-16T21:02:34.545ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
27922024-12-16T21:02:34.545ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27932024-12-16T21:02:34.545ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27942024-12-16T21:02:34.545ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
27952024-12-16T21:02:34.549ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27962024-12-16T21:02:34.549ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
27972024-12-16T21:02:34.552ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
27982024-12-16T21:02:34.552ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
27992024-12-16T21:02:34.555ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28002024-12-16T21:02:34.555ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cc15802f-1bb7-4b4f-9d1b-32465a11699f")) node_id = 0 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28012024-12-16T21:02:34.558ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28022024-12-16T21:02:34.558ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28032024-12-16T21:02:34.562ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 parent_lock = UpdaterLock { updater_id: d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122, locked_gen: Generation(Generation(2)) } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28042024-12-16T21:02:34.562ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = BecomeUpdater
28052024-12-16T21:02:34.562ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = BecomeUpdater
28062024-12-16T21:02:34.575ZDEBGnexus (SagaExecutor): inherited lock from d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122 to cc15802f-1bb7-4b4f-9d1b-32465a11699f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = BecomeUpdater updater_id = cc15802f-1bb7-4b4f-9d1b-32465a11699f
28072024-12-16T21:02:34.575ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28082024-12-16T21:02:34.575ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28092024-12-16T21:02:34.575ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cc15802f-1bb7-4b4f-9d1b-32465a11699f")}) node_id = 1 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28102024-12-16T21:02:34.578ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28112024-12-16T21:02:34.578ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28122024-12-16T21:02:34.581ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28132024-12-16T21:02:34.581ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28142024-12-16T21:02:34.585ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28152024-12-16T21:02:34.585ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28162024-12-16T21:02:34.588ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28172024-12-16T21:02:34.591ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8
28182024-12-16T21:02:34.593ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UpdateNetworkConfig
28192024-12-16T21:02:34.593ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UpdateNetworkConfig
28202024-12-16T21:02:34.597ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UpdateNetworkConfig
28212024-12-16T21:02:34.597ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UpdateNetworkConfig
28222024-12-16T21:02:34.599ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
28232024-12-16T21:02:34.599ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UpdateNetworkConfig
28242024-12-16T21:02:34.599ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UpdateNetworkConfig
28252024-12-16T21:02:34.602ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
28262024-12-16T21:02:34.602ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
28272024-12-16T21:02:34.602ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
28282024-12-16T21:02:34.603ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
28292024-12-16T21:02:34.604ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
28302024-12-16T21:02:34.604ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
28312024-12-16T21:02:34.605ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
28322024-12-16T21:02:34.609ZDEBGnexus: notifying dendrite of updates instance_id = Some(4e413624-9cb3-4b0b-9b33-4dc7141193b8 (instance)) switch = switch0
28332024-12-16T21:02:34.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1883, tv_nsec: 141012090 } })
28342024-12-16T21:02:34.610ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
28352024-12-16T21:02:34.640ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28362024-12-16T21:02:34.640ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28372024-12-16T21:02:34.641ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5514ca88-66e8-40e6-bfa0-4c3dc5b6278a", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:34 GMT"} })
28382024-12-16T21:02:34.641ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28392024-12-16T21:02:34.642ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28402024-12-16T21:02:34.671ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
28412024-12-16T21:02:34.671ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aa8cb70-95a0-4070-a91a-3a400eb5adc9", "content-length": "4", "date": "Mon, 16 Dec 2024 21:02:33 GMT"} })
28422024-12-16T21:02:34.673ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28432024-12-16T21:02:34.673ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28442024-12-16T21:02:34.677ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28452024-12-16T21:02:34.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28462024-12-16T21:02:34.679ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
28472024-12-16T21:02:34.680ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
28482024-12-16T21:02:34.692ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-16T21:02:34.682647Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, time_modified: Some(2024-12-16T21:02:34.682647Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, time_modified: Some(2024-12-16T21:02:34.682647Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28492024-12-16T21:02:34.692ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28502024-12-16T21:02:34.692ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28512024-12-16T21:02:34.696ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28522024-12-16T21:02:34.696ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28532024-12-16T21:02:34.699ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28542024-12-16T21:02:34.701ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UnassignOximeterProducer
28552024-12-16T21:02:34.701ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UnassignOximeterProducer
28562024-12-16T21:02:34.706ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb producer_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28572024-12-16T21:02:34.706ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UnassignOximeterProducer
28582024-12-16T21:02:34.706ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = UnassignOximeterProducer
28592024-12-16T21:02:34.741ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28602024-12-16T21:02:34.743ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/4e413624-9cb3-4b0b-9b33-4dc7141193b8
28612024-12-16T21:02:34.759ZDEBGnexus (SagaExecutor): client response oximeter-collector = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/4e413624-9cb3-4b0b-9b33-4dc7141193b8", status: 204, headers: {"x-request-id": "afb471a5-6a3c-41ae-b078-97f6c53d7be6", "date": "Mon, 16 Dec 2024 21:02:34 GMT"} }) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28622024-12-16T21:02:34.759ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb producer_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28632024-12-16T21:02:34.761ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28642024-12-16T21:02:34.761ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28652024-12-16T21:02:34.765ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28662024-12-16T21:02:34.765ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28672024-12-16T21:02:34.767ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 lock = UpdaterLock { updater_id: cc15802f-1bb7-4b4f-9d1b-32465a11699f, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-16T21:02:34.504766814Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28682024-12-16T21:02:34.767ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = CommitInstanceUpdates
28692024-12-16T21:02:34.768ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = CommitInstanceUpdates
28702024-12-16T21:02:34.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9f0d168c-f63e-4ecc-9eb3-3fafd6dd9572 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
28712024-12-16T21:02:34.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9f0d168c-f63e-4ecc-9eb3-3fafd6dd9572 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
28722024-12-16T21:02:34.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9f0d168c-f63e-4ecc-9eb3-3fafd6dd9572 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
28732024-12-16T21:02:34.805ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 new_runtime = InstanceRuntimeState { time_updated: 2024-12-16T21:02:34.504766814Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
28742024-12-16T21:02:34.805ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28752024-12-16T21:02:34.805ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28762024-12-16T21:02:34.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
28772024-12-16T21:02:34.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
28782024-12-16T21:02:34.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28792024-12-16T21:02:34.805ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28802024-12-16T21:02:34.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28812024-12-16T21:02:34.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28822024-12-16T21:02:34.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28832024-12-16T21:02:34.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28842024-12-16T21:02:34.807ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28852024-12-16T21:02:34.807ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28862024-12-16T21:02:34.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28872024-12-16T21:02:34.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28882024-12-16T21:02:34.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28892024-12-16T21:02:34.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28902024-12-16T21:02:34.810ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28912024-12-16T21:02:34.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("4e413624-9cb3-4b0b-9b33-4dc7141193b8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("509c6491-01b0-4a11-b979-5fc7a21d9623")}) node_id = 7 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28922024-12-16T21:02:34.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28932024-12-16T21:02:34.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28942024-12-16T21:02:34.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28952024-12-16T21:02:34.813ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28962024-12-16T21:02:34.813ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28972024-12-16T21:02:34.817ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
28982024-12-16T21:02:34.817ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
28992024-12-16T21:02:34.820ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29002024-12-16T21:02:34.820ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29012024-12-16T21:02:34.828ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
29022024-12-16T21:02:34.828ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ReleaseSledResources
29032024-12-16T21:02:34.828ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ReleaseSledResources
29042024-12-16T21:02:34.839ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29052024-12-16T21:02:34.839ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29062024-12-16T21:02:34.844ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29072024-12-16T21:02:34.844ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29082024-12-16T21:02:34.845ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8122840e-46f8-4f7a-965e-259c8e78a607", "content-length": "372", "date": "Mon, 16 Dec 2024 21:02:34 GMT"} })
29092024-12-16T21:02:34.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29102024-12-16T21:02:34.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29112024-12-16T21:02:34.848ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29122024-12-16T21:02:34.848ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29132024-12-16T21:02:34.851ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 propolis_id = 509c6491-01b0-4a11-b979-5fc7a21d9623 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
29142024-12-16T21:02:34.851ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = MarkVmmDeleted
29152024-12-16T21:02:34.851ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = MarkVmmDeleted
29162024-12-16T21:02:34.861ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29172024-12-16T21:02:34.861ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29182024-12-16T21:02:34.866ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29192024-12-16T21:02:34.866ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29202024-12-16T21:02:34.869ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29212024-12-16T21:02:34.869ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29222024-12-16T21:02:34.872ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29232024-12-16T21:02:34.872ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29242024-12-16T21:02:34.876ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29252024-12-16T21:02:34.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29262024-12-16T21:02:34.877ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29272024-12-16T21:02:34.877ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29282024-12-16T21:02:34.878ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29292024-12-16T21:02:34.879ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29302024-12-16T21:02:34.887ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d098904b-f205-4d2c-88a1-a8808b206d59: {10.151.2.176: {d7e19738-b63c-450f-913c-442e8f09026d}, 10.151.2.175: {d7e19738-b63c-450f-913c-442e8f09026d}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29312024-12-16T21:02:34.887ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29322024-12-16T21:02:34.887ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "259427fe-3fc1-45bf-9a8b-3e57d53174e5", "date": "Mon, 16 Dec 2024 21:02:34 GMT"} })
29332024-12-16T21:02:34.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29342024-12-16T21:02:34.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29352024-12-16T21:02:34.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29362024-12-16T21:02:34.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29372024-12-16T21:02:34.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29382024-12-16T21:02:34.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29392024-12-16T21:02:34.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29402024-12-16T21:02:34.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29412024-12-16T21:02:34.898ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29422024-12-16T21:02:34.898ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29432024-12-16T21:02:34.898ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "eab6065f-e9db-43ff-b8b4-d1a3d377cc70", "date": "Mon, 16 Dec 2024 21:02:34 GMT"} })
29442024-12-16T21:02:34.900ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 95.74738ms iteration = 27 status = {}
29452024-12-16T21:02:34.912ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29462024-12-16T21:02:34.916ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, lookup_type: ById(4496ac4b-bda9-4b4f-a09a-c65109be50f4) }, key: 78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed, lookup_type: ById(78b1923e-1b6f-4f8e-83a8-dd814c5cc9ed) }, key: 4e413624-9cb3-4b0b-9b33-4dc7141193b8, lookup_type: ById(4e413624-9cb3-4b0b-9b33-4dc7141193b8) } result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29472024-12-16T21:02:34.916ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29482024-12-16T21:02:34.916ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_node = ChainSuccessorSaga
29492024-12-16T21:02:34.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29502024-12-16T21:02:34.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29512024-12-16T21:02:34.992ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update
29522024-12-16T21:02:34.992ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29532024-12-16T21:02:34.992ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29542024-12-16T21:02:34.992ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
29552024-12-16T21:02:34.992ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29562024-12-16T21:02:34.992ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29572024-12-16T21:02:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29582024-12-16T21:02:34.997ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29592024-12-16T21:02:34.997ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29602024-12-16T21:02:35.001ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29612024-12-16T21:02:35.001ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29622024-12-16T21:02:35.006ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = be15a13e-163d-4dc8-9be7-21945c297066 sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29632024-12-16T21:02:35.006ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = be15a13e-163d-4dc8-9be7-21945c297066
29642024-12-16T21:02:35.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29652024-12-16T21:02:35.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29662024-12-16T21:02:35.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29672024-12-16T21:02:35.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29682024-12-16T21:02:35.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-12-16T21:02:35.018ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29702024-12-16T21:02:35.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29712024-12-16T21:02:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29722024-12-16T21:02:35.023ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29732024-12-16T21:02:35.023ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29742024-12-16T21:02:35.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29752024-12-16T21:02:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29762024-12-16T21:02:35.050ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29772024-12-16T21:02:35.050ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = be15a13e-163d-4dc8-9be7-21945c297066 saga_name = instance-update saga_result = SagaResult { saga_id: be15a13e-163d-4dc8-9be7-21945c297066, saga_log: SagaLog { saga_id: be15a13e-163d-4dc8-9be7-21945c297066, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("cc15802f-1bb7-4b4f-9d1b-32465a11699f")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cc15802f-1bb7-4b4f-9d1b-32465a11699f")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("4e413624-9cb3-4b0b-9b33-4dc7141193b8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("509c6491-01b0-4a11-b979-5fc7a21d9623")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("4e413624-9cb3-4b0b-9b33-4dc7141193b8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("509c6491-01b0-4a11-b979-5fc7a21d9623")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("cc15802f-1bb7-4b4f-9d1b-32465a11699f"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("cc15802f-1bb7-4b4f-9d1b-32465a11699f")}} }) }
29782024-12-16T21:02:35.050ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = be15a13e-163d-4dc8-9be7-21945c297066 instance_id = 4e413624-9cb3-4b0b-9b33-4dc7141193b8 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update
29792024-12-16T21:02:35.050ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29802024-12-16T21:02:35.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
29812024-12-16T21:02:35.052ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29822024-12-16T21:02:35.054ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29832024-12-16T21:02:35.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
29842024-12-16T21:02:35.056ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbdb80e6-e1a5-4b4c-82d8-6feaaab4ae96", "content-length": "691", "date": "Mon, 16 Dec 2024 21:02:34 GMT"} })
29852024-12-16T21:02:35.056ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29862024-12-16T21:02:35.056ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29872024-12-16T21:02:35.056ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29882024-12-16T21:02:35.057ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 252.946993ms iteration = 26 status = {}
29892024-12-16T21:02:35.058ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29902024-12-16T21:02:35.058ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
29912024-12-16T21:02:35.061ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29922024-12-16T21:02:35.062ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29932024-12-16T21:02:35.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29942024-12-16T21:02:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29952024-12-16T21:02:35.065ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
29962024-12-16T21:02:35.065ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a
29972024-12-16T21:02:35.098ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29982024-12-16T21:02:35.098ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29992024-12-16T21:02:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.051307ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30002024-12-16T21:02:35.102ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update sec_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
30012024-12-16T21:02:35.102ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f321381d-f533-4eda-a71c-8e55b1886f2a saga_name = start-instance-update saga_result = SagaResult { saga_id: f321381d-f533-4eda-a71c-8e55b1886f2a, saga_log: SagaLog { saga_id: f321381d-f533-4eda-a71c-8e55b1886f2a, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d68c4b7c-549b-45e9-9ce8-6d4f9ae1c122")}} }) }
30022024-12-16T21:02:35.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 9db3a0c7-c78a-4d35-9a8c-5776ee4af979 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
30032024-12-16T21:02:35.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 9db3a0c7-c78a-4d35-9a8c-5776ee4af979 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
30042024-12-16T21:02:35.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 9db3a0c7-c78a-4d35-9a8c-5776ee4af979 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
30052024-12-16T21:02:35.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7ac6a92c-aa9f-4f4b-bc5e-144ab5cff063 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30062024-12-16T21:02:35.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7ac6a92c-aa9f-4f4b-bc5e-144ab5cff063 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30072024-12-16T21:02:35.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7ac6a92c-aa9f-4f4b-bc5e-144ab5cff063 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30082024-12-16T21:02:35.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
30092024-12-16T21:02:35.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30102024-12-16T21:02:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30112024-12-16T21:02:35.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
30122024-12-16T21:02:35.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30132024-12-16T21:02:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30142024-12-16T21:02:35.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30152024-12-16T21:02:35.996ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30162024-12-16T21:02:35.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30172024-12-16T21:02:35.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30182024-12-16T21:02:35.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192024-12-16T21:02:35.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30202024-12-16T21:02:36.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30212024-12-16T21:02:36.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30222024-12-16T21:02:36.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30232024-12-16T21:02:36.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
30242024-12-16T21:02:36.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30252024-12-16T21:02:36.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30262024-12-16T21:02:36.016ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
30272024-12-16T21:02:36.016ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.618708ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
30282024-12-16T21:02:36.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.811314ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30292024-12-16T21:02:36.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 69ec7936-ac06-4d20-8a3c-eb44327d760e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30302024-12-16T21:02:36.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 69ec7936-ac06-4d20-8a3c-eb44327d760e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30312024-12-16T21:02:36.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 69ec7936-ac06-4d20-8a3c-eb44327d760e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30322024-12-16T21:02:37.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc4d61b8-cf70-4249-9318-f39ad39efc33 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30332024-12-16T21:02:37.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc4d61b8-cf70-4249-9318-f39ad39efc33 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30342024-12-16T21:02:37.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bc4d61b8-cf70-4249-9318-f39ad39efc33 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30352024-12-16T21:02:38.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 596287da-153b-40e2-8711-263dec2b1816 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30362024-12-16T21:02:38.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 596287da-153b-40e2-8711-263dec2b1816 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30372024-12-16T21:02:38.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 596287da-153b-40e2-8711-263dec2b1816 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30382024-12-16T21:02:39.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d60b706a-8bf8-47e3-9b02-31ec049ae8c0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30392024-12-16T21:02:39.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d60b706a-8bf8-47e3-9b02-31ec049ae8c0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30402024-12-16T21:02:39.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d60b706a-8bf8-47e3-9b02-31ec049ae8c0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30412024-12-16T21:02:40.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 977dc13f-b348-46d6-bc45-2423b154e917 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30422024-12-16T21:02:40.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 977dc13f-b348-46d6-bc45-2423b154e917 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30432024-12-16T21:02:40.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 977dc13f-b348-46d6-bc45-2423b154e917 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30442024-12-16T21:02:41.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1bcbe899-d962-4d61-91e4-e03b04fbb894 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30452024-12-16T21:02:41.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1bcbe899-d962-4d61-91e4-e03b04fbb894 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30462024-12-16T21:02:41.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1bcbe899-d962-4d61-91e4-e03b04fbb894 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30472024-12-16T21:02:42.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1413 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = d0222936-ccb6-452f-9416-3f4a606210d9 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
30482024-12-16T21:02:42.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d43415d6-75b1-4bfd-8b68-9eaa1ad3d91a roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30492024-12-16T21:02:42.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d43415d6-75b1-4bfd-8b68-9eaa1ad3d91a resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30502024-12-16T21:02:42.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = d43415d6-75b1-4bfd-8b68-9eaa1ad3d91a response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30512024-12-16T21:02:43.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 656578a7-5815-4d4c-852b-82bdbbae4c96 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30522024-12-16T21:02:43.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 656578a7-5815-4d4c-852b-82bdbbae4c96 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30532024-12-16T21:02:43.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 656578a7-5815-4d4c-852b-82bdbbae4c96 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30542024-12-16T21:02:45.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ee1c4e6c-a259-4aee-99ef-2057b8118c27 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30552024-12-16T21:02:45.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ee1c4e6c-a259-4aee-99ef-2057b8118c27 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30562024-12-16T21:02:45.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = ee1c4e6c-a259-4aee-99ef-2057b8118c27 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
30572024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
30582024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
30592024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
30602024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30612024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30622024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30632024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
30642024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30652024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
30662024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
30672024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30682024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30692024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30702024-12-16T21:02:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30712024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30722024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30732024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
30742024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
30752024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30762024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30772024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
30782024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30792024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
30802024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30812024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30822024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
30832024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30842024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
30852024-12-16T21:02:45.967ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30862024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
30872024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30882024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30892024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30902024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30912024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30922024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30932024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30942024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30952024-12-16T21:02:45.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30962024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
30972024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
30982024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30992024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31002024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
31012024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31022024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
31032024-12-16T21:02:45.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31042024-12-16T21:02:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31052024-12-16T21:02:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31062024-12-16T21:02:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31072024-12-16T21:02:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31082024-12-16T21:02:45.969ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1894, tv_nsec: 500163328 } })
31092024-12-16T21:02:45.969ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
31102024-12-16T21:02:45.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-12-16T21:02:45.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.372364ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31122024-12-16T21:02:45.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31132024-12-16T21:02:45.971ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1894, tv_nsec: 502357039 } })
31142024-12-16T21:02:45.972ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31152024-12-16T21:02:45.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31162024-12-16T21:02:45.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31172024-12-16T21:02:45.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31182024-12-16T21:02:45.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31192024-12-16T21:02:45.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31202024-12-16T21:02:45.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31212024-12-16T21:02:45.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-12-16T21:02:45.976ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31232024-12-16T21:02:45.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31242024-12-16T21:02:45.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31252024-12-16T21:02:45.978ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31262024-12-16T21:02:45.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31272024-12-16T21:02:45.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31282024-12-16T21:02:45.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31292024-12-16T21:02:45.983ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1894, tv_nsec: 514041703 } })
31302024-12-16T21:02:45.983ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
31312024-12-16T21:02:46.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31322024-12-16T21:02:46.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31332024-12-16T21:02:46.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31342024-12-16T21:02:46.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31352024-12-16T21:02:46.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-12-16T21:02:46.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31372024-12-16T21:02:46.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31382024-12-16T21:02:46.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31392024-12-16T21:02:46.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31402024-12-16T21:02:46.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31412024-12-16T21:02:46.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422024-12-16T21:02:46.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31432024-12-16T21:02:46.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31442024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31452024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31462024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31472024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31482024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31492024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31502024-12-16T21:02:46.022ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31512024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31522024-12-16T21:02:46.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31532024-12-16T21:02:46.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31542024-12-16T21:02:46.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31552024-12-16T21:02:46.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.675483ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31562024-12-16T21:02:46.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.868728ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
31572024-12-16T21:02:46.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-12-16T21:02:46.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31592024-12-16T21:02:46.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31602024-12-16T21:02:46.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31612024-12-16T21:02:46.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31622024-12-16T21:02:46.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31632024-12-16T21:02:46.027ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31642024-12-16T21:02:46.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31652024-12-16T21:02:46.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31662024-12-16T21:02:46.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31672024-12-16T21:02:46.028ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.6506ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
31682024-12-16T21:02:46.030ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31692024-12-16T21:02:46.030ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.666488ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
31702024-12-16T21:02:46.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3c88deed-d5eb-4638-8d0d-5c60329d1ed8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
31712024-12-16T21:02:46.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3c88deed-d5eb-4638-8d0d-5c60329d1ed8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
31722024-12-16T21:02:46.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 3c88deed-d5eb-4638-8d0d-5c60329d1ed8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
31732024-12-16T21:02:46.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31742024-12-16T21:02:46.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31752024-12-16T21:02:46.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31762024-12-16T21:02:46.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.557499ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31772024-12-16T21:02:46.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
31782024-12-16T21:02:46.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31792024-12-16T21:02:46.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31802024-12-16T21:02:46.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31812024-12-16T21:02:46.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-12-16T21:02:46.063ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31832024-12-16T21:02:46.063ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31842024-12-16T21:02:46.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31852024-12-16T21:02:46.063ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.591545ms iteration = 26 status = 0
31862024-12-16T21:02:46.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31872024-12-16T21:02:46.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31882024-12-16T21:02:46.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31892024-12-16T21:02:46.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31902024-12-16T21:02:46.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
31912024-12-16T21:02:46.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31922024-12-16T21:02:46.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31932024-12-16T21:02:46.066ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31942024-12-16T21:02:46.066ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31952024-12-16T21:02:46.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.087614ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31962024-12-16T21:02:46.066ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e14dd380-a6ae-4abe-a14b-70f6c3fb0cb2", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
31972024-12-16T21:02:46.066ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31982024-12-16T21:02:46.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31992024-12-16T21:02:46.067ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32002024-12-16T21:02:46.067ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0ac60c2-92ce-498e-99a4-973a31c9e39c", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32012024-12-16T21:02:46.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32022024-12-16T21:02:46.068ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32032024-12-16T21:02:46.069ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32042024-12-16T21:02:46.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
32052024-12-16T21:02:46.078ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32062024-12-16T21:02:46.078ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4803d4f-0536-4787-b7b2-e3a8a6273b3f", "content-length": "26", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32072024-12-16T21:02:46.078ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32082024-12-16T21:02:46.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
32092024-12-16T21:02:46.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.901977ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
32102024-12-16T21:02:46.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
32112024-12-16T21:02:46.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32122024-12-16T21:02:46.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32132024-12-16T21:02:46.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.305456ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
32142024-12-16T21:02:46.095ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32152024-12-16T21:02:46.095ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32162024-12-16T21:02:46.095ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.590838ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32172024-12-16T21:02:46.159ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32182024-12-16T21:02:46.160ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "04f8b239-31a4-4a64-8e30-93766e38e570", "content-length": "2", "date": "Mon, 16 Dec 2024 21:02:45 GMT"} })
32192024-12-16T21:02:46.161ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.656929ms iteration = 30 status = {"physical_disks_added":0}
32202024-12-16T21:02:46.162ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32212024-12-16T21:02:46.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32222024-12-16T21:02:46.169ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.985588ms iteration = 26 status = {}
32232024-12-16T21:02:46.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32242024-12-16T21:02:46.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32252024-12-16T21:02:46.186ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32262024-12-16T21:02:46.186ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32272024-12-16T21:02:46.187ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e19f4d0-faa1-4211-ba0a-adc34a311196", "content-length": "372", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32282024-12-16T21:02:46.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32292024-12-16T21:02:46.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32302024-12-16T21:02:46.188ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 222.245516ms iteration = 26 status = null
32312024-12-16T21:02:46.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32322024-12-16T21:02:46.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32332024-12-16T21:02:46.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32342024-12-16T21:02:46.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32352024-12-16T21:02:46.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32362024-12-16T21:02:46.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32372024-12-16T21:02:46.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32382024-12-16T21:02:46.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32392024-12-16T21:02:46.230ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32402024-12-16T21:02:46.230ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32412024-12-16T21:02:46.230ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "abb0d63f-3430-446e-962e-caec49989e7a", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32422024-12-16T21:02:46.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32432024-12-16T21:02:46.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32442024-12-16T21:02:46.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32452024-12-16T21:02:46.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32462024-12-16T21:02:46.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32472024-12-16T21:02:46.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32482024-12-16T21:02:46.238ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32492024-12-16T21:02:46.238ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32502024-12-16T21:02:46.238ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5a10c181-d70b-4495-95f1-9676d9373d5c", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32512024-12-16T21:02:46.240ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.111078ms iteration = 28 status = {}
32522024-12-16T21:02:46.261ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32532024-12-16T21:02:46.262ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e291a6-0050-4fd4-9c08-1c8e71e9bf2c", "content-length": "691", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32542024-12-16T21:02:46.262ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32552024-12-16T21:02:46.262ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32562024-12-16T21:02:46.262ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32572024-12-16T21:02:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 295.608488ms iteration = 27 status = {}
32582024-12-16T21:02:46.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32592024-12-16T21:02:46.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32602024-12-16T21:02:46.279ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
32612024-12-16T21:02:46.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32622024-12-16T21:02:46.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32632024-12-16T21:02:46.289ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32642024-12-16T21:02:46.289ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5c5fc6e-e28e-4e47-8ddb-31167dd00ab6", "content-length": "134", "date": "Mon, 16 Dec 2024 21:02:45 GMT"} })
32652024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32662024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
32672024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32682024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32692024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32702024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32712024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32722024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32732024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32742024-12-16T21:02:46.289ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32752024-12-16T21:02:46.290ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
32762024-12-16T21:02:46.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32772024-12-16T21:02:46.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32782024-12-16T21:02:46.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32792024-12-16T21:02:46.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cd43259-dc69-4994-adf0-61dd82a2443a", "content-length": "2", "date": "Mon, 16 Dec 2024 21:02:45 GMT"} })
32802024-12-16T21:02:46.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32812024-12-16T21:02:46.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "63b3c6a3-eadf-4e86-ab5d-0272d4a5ce89", "content-length": "52", "date": "Mon, 16 Dec 2024 21:02:45 GMT"} })
32822024-12-16T21:02:46.292ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
32832024-12-16T21:02:46.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32842024-12-16T21:02:46.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e1710020-79f1-477d-8b76-4892e7237a09", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32852024-12-16T21:02:46.389ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
32862024-12-16T21:02:46.389ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32872024-12-16T21:02:46.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b332a960-e63a-4de7-9c7c-457c3916c301", "content-length": "682", "date": "Mon, 16 Dec 2024 21:02:46 GMT"} })
32882024-12-16T21:02:46.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32892024-12-16T21:02:46.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32902024-12-16T21:02:46.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32912024-12-16T21:02:46.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32922024-12-16T21:02:46.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32932024-12-16T21:02:46.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32942024-12-16T21:02:46.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32952024-12-16T21:02:46.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32962024-12-16T21:02:46.412ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 444.842329ms iteration = 26 status = {}
32972024-12-16T21:02:47.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 172caf3a-1f03-4a78-baa3-3653f0b99d33 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
32982024-12-16T21:02:47.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 172caf3a-1f03-4a78-baa3-3653f0b99d33 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
32992024-12-16T21:02:47.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 172caf3a-1f03-4a78-baa3-3653f0b99d33 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33002024-12-16T21:02:48.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 846b5491-6109-4746-8a1e-a0cf3bcac407 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33012024-12-16T21:02:48.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 846b5491-6109-4746-8a1e-a0cf3bcac407 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33022024-12-16T21:02:48.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 846b5491-6109-4746-8a1e-a0cf3bcac407 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33032024-12-16T21:02:49.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6bd5fcdd-6cbb-4257-a80d-521d085923d5 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33042024-12-16T21:02:49.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6bd5fcdd-6cbb-4257-a80d-521d085923d5 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33052024-12-16T21:02:49.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6bd5fcdd-6cbb-4257-a80d-521d085923d5 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33062024-12-16T21:02:50.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5f913ddd-8fd9-4353-9130-15c1511c5854 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33072024-12-16T21:02:50.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5f913ddd-8fd9-4353-9130-15c1511c5854 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33082024-12-16T21:02:50.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5f913ddd-8fd9-4353-9130-15c1511c5854 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33092024-12-16T21:02:51.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 67f861f6-55cd-4750-950d-5588211ff737 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33102024-12-16T21:02:51.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 67f861f6-55cd-4750-950d-5588211ff737 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33112024-12-16T21:02:51.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 67f861f6-55cd-4750-950d-5588211ff737 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33122024-12-16T21:02:52.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9ae1b25e-66e0-4adb-81d2-64cd774d3499 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33132024-12-16T21:02:52.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9ae1b25e-66e0-4adb-81d2-64cd774d3499 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33142024-12-16T21:02:52.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9ae1b25e-66e0-4adb-81d2-64cd774d3499 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33152024-12-16T21:02:52.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1448 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 8f1722d8-d616-4bb3-a591-631b0e8922e1 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
33162024-12-16T21:02:53.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02fc0251-1e84-4805-a1e8-de01de196edf roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33172024-12-16T21:02:53.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02fc0251-1e84-4805-a1e8-de01de196edf resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33182024-12-16T21:02:53.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02fc0251-1e84-4805-a1e8-de01de196edf response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33192024-12-16T21:02:54.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aa66ed71-faf4-4b96-9498-b9ac421d5ae4 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33202024-12-16T21:02:54.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aa66ed71-faf4-4b96-9498-b9ac421d5ae4 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33212024-12-16T21:02:54.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aa66ed71-faf4-4b96-9498-b9ac421d5ae4 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33222024-12-16T21:02:55.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b69ab0e8-5065-47a6-8837-63ec375b7738 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33232024-12-16T21:02:55.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b69ab0e8-5065-47a6-8837-63ec375b7738 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33242024-12-16T21:02:55.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b69ab0e8-5065-47a6-8837-63ec375b7738 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33252024-12-16T21:02:55.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
33262024-12-16T21:02:55.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33272024-12-16T21:02:55.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33282024-12-16T21:02:55.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
33292024-12-16T21:02:55.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33302024-12-16T21:02:55.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33312024-12-16T21:02:55.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322024-12-16T21:02:55.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33332024-12-16T21:02:55.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33342024-12-16T21:02:55.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33352024-12-16T21:02:55.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33362024-12-16T21:02:55.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33372024-12-16T21:02:55.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33382024-12-16T21:02:55.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
33392024-12-16T21:02:55.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33402024-12-16T21:02:55.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33412024-12-16T21:02:55.996ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
33422024-12-16T21:02:55.996ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.991142ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
33432024-12-16T21:02:56.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33442024-12-16T21:02:56.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33452024-12-16T21:02:56.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.071247ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33462024-12-16T21:02:56.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b103ca24-c114-4366-a1f4-9084d47e62f9 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33472024-12-16T21:02:56.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b103ca24-c114-4366-a1f4-9084d47e62f9 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33482024-12-16T21:02:56.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b103ca24-c114-4366-a1f4-9084d47e62f9 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33492024-12-16T21:02:57.173ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:56743
33502024-12-16T21:02:57.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 369b0e4b-10b2-44b2-82b4-680edfb6f412 roles = RoleSet { roles: {} } uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?sort_by=id_ascending
33512024-12-16T21:02:57.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 369b0e4b-10b2-44b2-82b4-680edfb6f412 resource = Database result = Ok(()) uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?sort_by=id_ascending
33522024-12-16T21:02:57.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 369b0e4b-10b2-44b2-82b4-680edfb6f412 response_code = 200 uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?sort_by=id_ascending
33532024-12-16T21:02:57.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 06a5627f-01d1-4598-adba-26042e54d7d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2I4ZDU5Ni1kZjU2LTQ3NzEtOWRiMC1iODhlYTg3ZTFmOTQifX0%3D
33542024-12-16T21:02:57.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 06a5627f-01d1-4598-adba-26042e54d7d2 resource = Database result = Ok(()) uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2I4ZDU5Ni1kZjU2LTQ3NzEtOWRiMC1iODhlYTg3ZTFmOTQifX0%3D
33552024-12-16T21:02:57.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 06a5627f-01d1-4598-adba-26042e54d7d2 response_code = 200 uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2I4ZDU5Ni1kZjU2LTQ3NzEtOWRiMC1iODhlYTg3ZTFmOTQifX0%3D
33562024-12-16T21:02:57.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1c298ea5-e546-4441-88a8-52a127a9d5e8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33572024-12-16T21:02:57.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1c298ea5-e546-4441-88a8-52a127a9d5e8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33582024-12-16T21:02:57.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1c298ea5-e546-4441-88a8-52a127a9d5e8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33592024-12-16T21:02:57.718ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:39410
33602024-12-16T21:02:57.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39410 req_id = e60fe002-2157-428e-974e-550b6923b7e0 roles = RoleSet { roles: {} } uri = /metrics/producers
33612024-12-16T21:02:57.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39410 req_id = e60fe002-2157-428e-974e-550b6923b7e0 resource = Database result = Ok(()) uri = /metrics/producers
33622024-12-16T21:02:57.757ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = ede88c21-b3b8-44c9-a8b3-4e80aa518dc6
33632024-12-16T21:02:57.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38547 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39410 req_id = e60fe002-2157-428e-974e-550b6923b7e0 response_code = 201 uri = /metrics/producers
33642024-12-16T21:02:58.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0b9e5c6d-39f2-47fe-a790-ec97f8cdcd69 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33652024-12-16T21:02:58.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0b9e5c6d-39f2-47fe-a790-ec97f8cdcd69 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33662024-12-16T21:02:58.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0b9e5c6d-39f2-47fe-a790-ec97f8cdcd69 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33672024-12-16T21:02:59.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fd9e003d-4513-48b2-85bf-63da68957d28 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33682024-12-16T21:02:59.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fd9e003d-4513-48b2-85bf-63da68957d28 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33692024-12-16T21:02:59.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fd9e003d-4513-48b2-85bf-63da68957d28 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33702024-12-16T21:03:00.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bfc51c9d-d62e-4012-9674-d5cb347fa049 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33712024-12-16T21:03:00.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bfc51c9d-d62e-4012-9674-d5cb347fa049 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33722024-12-16T21:03:00.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bfc51c9d-d62e-4012-9674-d5cb347fa049 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33732024-12-16T21:03:01.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e6f098ab-93ff-4683-b46f-6af31990d637 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33742024-12-16T21:03:01.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e6f098ab-93ff-4683-b46f-6af31990d637 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33752024-12-16T21:03:01.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e6f098ab-93ff-4683-b46f-6af31990d637 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33762024-12-16T21:03:02.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1456 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 3373dff8-6977-46f5-9c65-2a3390c862b3 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
33772024-12-16T21:03:02.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fbd8c4cd-7abb-4c1f-852d-13f84014cb78 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33782024-12-16T21:03:02.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fbd8c4cd-7abb-4c1f-852d-13f84014cb78 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33792024-12-16T21:03:02.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fbd8c4cd-7abb-4c1f-852d-13f84014cb78 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33802024-12-16T21:03:02.590ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63165
33812024-12-16T21:03:02.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63165 req_id = 0960affd-1470-4a6d-a4ed-ebd610ad5709 roles = RoleSet { roles: {} } uri = /metrics/producers
33822024-12-16T21:03:02.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63165 req_id = 0960affd-1470-4a6d-a4ed-ebd610ad5709 resource = Database result = Ok(()) uri = /metrics/producers
33832024-12-16T21:03:02.634ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 1222b2a4-5a9b-4afb-9176-bbb6ce6e62c8
33842024-12-16T21:03:02.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44178 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63165 req_id = 0960affd-1470-4a6d-a4ed-ebd610ad5709 response_code = 201 uri = /metrics/producers
33852024-12-16T21:03:03.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6144dc6e-c9ce-4b9c-b341-5c010c2b50d0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33862024-12-16T21:03:03.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6144dc6e-c9ce-4b9c-b341-5c010c2b50d0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33872024-12-16T21:03:03.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6144dc6e-c9ce-4b9c-b341-5c010c2b50d0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33882024-12-16T21:03:04.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 419b8b0d-32de-4719-8983-4e433fb94784 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33892024-12-16T21:03:04.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 419b8b0d-32de-4719-8983-4e433fb94784 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33902024-12-16T21:03:04.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 419b8b0d-32de-4719-8983-4e433fb94784 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33912024-12-16T21:03:05.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = d2436eac-5067-41f7-af67-4fff21753bbc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
33922024-12-16T21:03:05.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = d2436eac-5067-41f7-af67-4fff21753bbc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
33932024-12-16T21:03:05.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = d2436eac-5067-41f7-af67-4fff21753bbc response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
33942024-12-16T21:03:05.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b9a2f1f-cc8e-4301-a0d6-64e95c2fb4e6 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33952024-12-16T21:03:05.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b9a2f1f-cc8e-4301-a0d6-64e95c2fb4e6 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33962024-12-16T21:03:05.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7b9a2f1f-cc8e-4301-a0d6-64e95c2fb4e6 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
33972024-12-16T21:03:05.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
33982024-12-16T21:03:05.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33992024-12-16T21:03:05.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34002024-12-16T21:03:05.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
34012024-12-16T21:03:05.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34022024-12-16T21:03:05.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34032024-12-16T21:03:05.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34042024-12-16T21:03:05.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34052024-12-16T21:03:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34062024-12-16T21:03:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34072024-12-16T21:03:05.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34082024-12-16T21:03:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34092024-12-16T21:03:05.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34102024-12-16T21:03:05.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34112024-12-16T21:03:05.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34122024-12-16T21:03:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
34132024-12-16T21:03:05.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34142024-12-16T21:03:05.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34152024-12-16T21:03:05.988ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
34162024-12-16T21:03:05.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.230145ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
34172024-12-16T21:03:05.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.079594ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34182024-12-16T21:03:06.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dcf9c119-4c3e-4c2b-8a5d-573966a44f72 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34192024-12-16T21:03:06.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dcf9c119-4c3e-4c2b-8a5d-573966a44f72 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34202024-12-16T21:03:06.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dcf9c119-4c3e-4c2b-8a5d-573966a44f72 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34212024-12-16T21:03:07.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e5c26bd9-ef04-499b-b5fe-e757e2b735ea roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34222024-12-16T21:03:07.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e5c26bd9-ef04-499b-b5fe-e757e2b735ea resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34232024-12-16T21:03:07.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e5c26bd9-ef04-499b-b5fe-e757e2b735ea response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34242024-12-16T21:03:07.922ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
34252024-12-16T21:03:07.922ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
34262024-12-16T21:03:07.953ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
34272024-12-16T21:03:07.954ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62077
34282024-12-16T21:03:07.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62077 req_id = 04360bb9-9232-4fff-a7c4-609ac262faf0 roles = RoleSet { roles: {} } uri = /metrics/producers
34292024-12-16T21:03:07.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62077 req_id = 04360bb9-9232-4fff-a7c4-609ac262faf0 resource = Database result = Ok(()) uri = /metrics/producers
34302024-12-16T21:03:07.986ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
34312024-12-16T21:03:07.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32484 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62077 req_id = 04360bb9-9232-4fff-a7c4-609ac262faf0 response_code = 201 uri = /metrics/producers
34322024-12-16T21:03:07.986ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "04360bb9-9232-4fff-a7c4-609ac262faf0", "content-length": "41", "date": "Mon, 16 Dec 2024 21:03:07 GMT"} })
34332024-12-16T21:03:07.989ZDEBGnexus (producer-registration-task): registered with nexus successfully
34342024-12-16T21:03:07.989ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
34352024-12-16T21:03:08.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7d1ec9fb-987c-4168-b6ee-003501beeb31 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34362024-12-16T21:03:08.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7d1ec9fb-987c-4168-b6ee-003501beeb31 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34372024-12-16T21:03:08.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7d1ec9fb-987c-4168-b6ee-003501beeb31 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34382024-12-16T21:03:08.804ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:65103
34392024-12-16T21:03:08.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65103 req_id = 0ea5347a-bc99-42f6-abab-43fc63bedc3d roles = RoleSet { roles: {} } uri = /metrics/producers
34402024-12-16T21:03:08.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65103 req_id = 0ea5347a-bc99-42f6-abab-43fc63bedc3d resource = Database result = Ok(()) uri = /metrics/producers
34412024-12-16T21:03:08.814ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 6202951a-b367-4347-b9c3-86c8b6bc919a
34422024-12-16T21:03:08.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10100 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65103 req_id = 0ea5347a-bc99-42f6-abab-43fc63bedc3d response_code = 201 uri = /metrics/producers
34432024-12-16T21:03:09.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8cf0f5f4-a976-4884-9854-c09c55056ba8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34442024-12-16T21:03:09.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8cf0f5f4-a976-4884-9854-c09c55056ba8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34452024-12-16T21:03:09.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8cf0f5f4-a976-4884-9854-c09c55056ba8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34462024-12-16T21:03:10.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2567156b-7372-434a-a7cf-f41ee61dc1d0 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34472024-12-16T21:03:10.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2567156b-7372-434a-a7cf-f41ee61dc1d0 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34482024-12-16T21:03:10.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2567156b-7372-434a-a7cf-f41ee61dc1d0 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34492024-12-16T21:03:11.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e2504918-807a-4ff6-9cb5-2cc9ba81a235 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34502024-12-16T21:03:11.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e2504918-807a-4ff6-9cb5-2cc9ba81a235 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34512024-12-16T21:03:11.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e2504918-807a-4ff6-9cb5-2cc9ba81a235 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34522024-12-16T21:03:12.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1381 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 00935f0a-52eb-4c64-b5ea-ff06327e68a6 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
34532024-12-16T21:03:12.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 698c9211-d2ed-43a2-b6be-a1b4c1d087bf roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34542024-12-16T21:03:12.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 698c9211-d2ed-43a2-b6be-a1b4c1d087bf resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34552024-12-16T21:03:12.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 698c9211-d2ed-43a2-b6be-a1b4c1d087bf response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34562024-12-16T21:03:13.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4b7b611c-ff92-4477-aa1e-ee156bf75fed roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34572024-12-16T21:03:13.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4b7b611c-ff92-4477-aa1e-ee156bf75fed resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34582024-12-16T21:03:13.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4b7b611c-ff92-4477-aa1e-ee156bf75fed response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34592024-12-16T21:03:14.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc3a2294-3637-48c1-bf20-4beca63ae490 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34602024-12-16T21:03:14.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc3a2294-3637-48c1-bf20-4beca63ae490 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34612024-12-16T21:03:14.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc3a2294-3637-48c1-bf20-4beca63ae490 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34622024-12-16T21:03:15.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 54bb0454-3bf9-4a8d-be40-4fde9d10f7ff roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34632024-12-16T21:03:15.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 54bb0454-3bf9-4a8d-be40-4fde9d10f7ff resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34642024-12-16T21:03:15.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 54bb0454-3bf9-4a8d-be40-4fde9d10f7ff response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
34652024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
34662024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
34672024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
34682024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34692024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
34702024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
34712024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
34722024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34732024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34742024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34752024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
34762024-12-16T21:03:15.966ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
34772024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
34782024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34792024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34802024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
34812024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
34822024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34832024-12-16T21:03:15.966ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-16 20:53:15.966522515 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34842024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34852024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
34862024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34872024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34882024-12-16T21:03:15.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
34892024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34902024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34912024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34922024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34932024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34942024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34952024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34962024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34972024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34982024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
34992024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
35002024-12-16T21:03:15.967ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35012024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35022024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35032024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
35042024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35052024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
35062024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
35072024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
35082024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
35092024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35102024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35112024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
35122024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35132024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35142024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
35152024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35162024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
35172024-12-16T21:03:15.967ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546
35182024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.711\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546"}
35192024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
35202024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
35212024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35222024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
35232024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35242024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
35252024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35262024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
35272024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35282024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
35292024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35302024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
35312024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
35322024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
35332024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
35342024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35352024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35362024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35372024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
35382024-12-16T21:03:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35392024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35402024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35412024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35422024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35432024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35442024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35452024-12-16T21:03:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2bad804c-125d-4b4f-bbb4-08849c8bee33.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e73705b-19c3-4191-883c-2bba82160d3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b71de63e-bd28-4173-9d76-157895abd57e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 498819964 } })
35462024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35472024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
35482024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35492024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35502024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35512024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35522024-12-16T21:03:15.968ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2119cbc5-42cf-405b-af5a-3fb6ae08bc7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2185e6c6-5b12-4687-9851-21db46e777e2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 498967687 } })
35532024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
35542024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
35552024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.131322ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
35562024-12-16T21:03:15.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.08256ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
35572024-12-16T21:03:15.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35582024-12-16T21:03:15.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592024-12-16T21:03:15.970ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 501128078 } })
35602024-12-16T21:03:15.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.301652ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35612024-12-16T21:03:15.970ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
35622024-12-16T21:03:15.971ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 501837211 } })
35632024-12-16T21:03:15.971ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642024-12-16T21:03:15.971ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
35652024-12-16T21:03:15.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35662024-12-16T21:03:15.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35672024-12-16T21:03:15.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35682024-12-16T21:03:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35692024-12-16T21:03:15.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35702024-12-16T21:03:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35712024-12-16T21:03:15.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35722024-12-16T21:03:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
35732024-12-16T21:03:15.973ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35742024-12-16T21:03:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35752024-12-16T21:03:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35762024-12-16T21:03:15.974ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-16 20:53:15.966522515 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35772024-12-16T21:03:15.974ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.691277ms iteration = 14 status = {"expiration":"2024-12-16T20:53:15.966522515Z","pruned":[]}
35782024-12-16T21:03:15.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792024-12-16T21:03:15.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35802024-12-16T21:03:15.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35812024-12-16T21:03:15.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35822024-12-16T21:03:15.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35832024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35842024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35852024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35862024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35872024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35882024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35892024-12-16T21:03:15.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35902024-12-16T21:03:15.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35912024-12-16T21:03:15.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35922024-12-16T21:03:15.981ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35932024-12-16T21:03:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35942024-12-16T21:03:15.983ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.092198ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
35952024-12-16T21:03:15.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962024-12-16T21:03:15.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35972024-12-16T21:03:15.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35982024-12-16T21:03:15.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992024-12-16T21:03:15.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36002024-12-16T21:03:15.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36012024-12-16T21:03:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36022024-12-16T21:03:15.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36032024-12-16T21:03:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36042024-12-16T21:03:15.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052024-12-16T21:03:15.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36062024-12-16T21:03:15.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36072024-12-16T21:03:15.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36082024-12-16T21:03:15.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36092024-12-16T21:03:15.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36102024-12-16T21:03:15.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36112024-12-16T21:03:15.997ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcb8d596-df56-4771-9db0-b88ea87e1f94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1924, tv_nsec: 528098743 } })
36122024-12-16T21:03:15.997ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
36132024-12-16T21:03:16.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142024-12-16T21:03:16.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36152024-12-16T21:03:16.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36162024-12-16T21:03:16.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36172024-12-16T21:03:16.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36182024-12-16T21:03:16.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
36192024-12-16T21:03:16.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36202024-12-16T21:03:16.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36212024-12-16T21:03:16.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36222024-12-16T21:03:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36232024-12-16T21:03:16.023ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36242024-12-16T21:03:16.023ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36252024-12-16T21:03:16.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36262024-12-16T21:03:16.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36272024-12-16T21:03:16.023ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36282024-12-16T21:03:16.023ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36292024-12-16T21:03:16.023ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.022421ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36302024-12-16T21:03:16.024ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36312024-12-16T21:03:16.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36322024-12-16T21:03:16.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36332024-12-16T21:03:16.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36342024-12-16T21:03:16.026ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36352024-12-16T21:03:16.026ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36362024-12-16T21:03:16.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36372024-12-16T21:03:16.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.637821ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36382024-12-16T21:03:16.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36392024-12-16T21:03:16.028ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.669039ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
36402024-12-16T21:03:16.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36412024-12-16T21:03:16.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36422024-12-16T21:03:16.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36432024-12-16T21:03:16.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36442024-12-16T21:03:16.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36452024-12-16T21:03:16.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36462024-12-16T21:03:16.030ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36472024-12-16T21:03:16.030ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
36482024-12-16T21:03:16.030ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 63.763838ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36492024-12-16T21:03:16.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502024-12-16T21:03:16.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.945771ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
36512024-12-16T21:03:16.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36522024-12-16T21:03:16.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36532024-12-16T21:03:16.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36542024-12-16T21:03:16.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcb8d596-df56-4771-9db0-b88ea87e1f94, lookup_type: ById(fcb8d596-df56-4771-9db0-b88ea87e1f94) } result = Ok(())
36552024-12-16T21:03:16.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36562024-12-16T21:03:16.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36572024-12-16T21:03:16.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36582024-12-16T21:03:16.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36592024-12-16T21:03:16.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36602024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36612024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36622024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36632024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36642024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36652024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
36662024-12-16T21:03:16.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.360135ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
36672024-12-16T21:03:16.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.478689ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36682024-12-16T21:03:16.036ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.535598ms iteration = 27 status = 0
36692024-12-16T21:03:16.042ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36702024-12-16T21:03:16.042ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36712024-12-16T21:03:16.042ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36722024-12-16T21:03:16.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36732024-12-16T21:03:16.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36742024-12-16T21:03:16.045ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36752024-12-16T21:03:16.045ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.859458ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36762024-12-16T21:03:16.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.366657ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36772024-12-16T21:03:16.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782024-12-16T21:03:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36792024-12-16T21:03:16.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36802024-12-16T21:03:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36812024-12-16T21:03:16.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36822024-12-16T21:03:16.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36832024-12-16T21:03:16.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36842024-12-16T21:03:16.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36852024-12-16T21:03:16.066ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36862024-12-16T21:03:16.066ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36872024-12-16T21:03:16.066ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.031282ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36882024-12-16T21:03:16.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36892024-12-16T21:03:16.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36902024-12-16T21:03:16.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36912024-12-16T21:03:16.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922024-12-16T21:03:16.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36932024-12-16T21:03:16.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36942024-12-16T21:03:16.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36952024-12-16T21:03:16.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36962024-12-16T21:03:16.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36972024-12-16T21:03:16.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36982024-12-16T21:03:16.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36992024-12-16T21:03:16.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37002024-12-16T21:03:16.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.524401ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37012024-12-16T21:03:16.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37022024-12-16T21:03:16.106ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37032024-12-16T21:03:16.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37042024-12-16T21:03:16.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37052024-12-16T21:03:16.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37062024-12-16T21:03:16.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37072024-12-16T21:03:16.118ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
37082024-12-16T21:03:16.118ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
37092024-12-16T21:03:16.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37102024-12-16T21:03:16.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37112024-12-16T21:03:16.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122024-12-16T21:03:16.122ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
37132024-12-16T21:03:16.122ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 0 version = 2
37142024-12-16T21:03:16.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37152024-12-16T21:03:16.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37162024-12-16T21:03:16.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-12-16T21:03:16.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37182024-12-16T21:03:16.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37192024-12-16T21:03:16.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37202024-12-16T21:03:16.125ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37212024-12-16T21:03:16.125ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 158.05146ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37222024-12-16T21:03:16.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37232024-12-16T21:03:16.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37242024-12-16T21:03:16.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37252024-12-16T21:03:16.130ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 zone_address = fd00:1122:3344:101::2
37262024-12-16T21:03:16.130ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37272024-12-16T21:03:16.131ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27abd51e-f6ce-4dcd-a72f-37f31c488f70", "content-length": "26", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37282024-12-16T21:03:16.131ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37292024-12-16T21:03:16.133ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
37302024-12-16T21:03:16.147ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-16T20:50:11.628239Z, time_modified: 2024-12-16T20:50:11.628239Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, db_silo: Silo { identity: SiloIdentity { id: 4496ac4b-bda9-4b4f-a09a-c65109be50f4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-16T20:50:36.771015Z, time_modified: 2024-12-16T20:50:36.771015Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e" }] }) }
37312024-12-16T21:03:16.148ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 181.514069ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]}},"default_endpoint":{"silo_id":"4496ac4b-bda9-4b4f-a09a-c65109be50f4","tls_certs":["fd4b3cadfb3eae02382943f3475175615e998f9334641022864f932ce532095e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37322024-12-16T21:03:16.155ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.778197ms iteration = 31 status = {"physical_disks_added":0}
37332024-12-16T21:03:16.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37342024-12-16T21:03:16.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37352024-12-16T21:03:16.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37362024-12-16T21:03:16.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37372024-12-16T21:03:16.262ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37382024-12-16T21:03:16.262ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "228c4639-508a-48e6-af1c-8c1041e9c666", "content-length": "26", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37392024-12-16T21:03:16.262ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37402024-12-16T21:03:16.263ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37412024-12-16T21:03:16.263ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37422024-12-16T21:03:16.263ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1cd207a-7c31-4778-b18e-7047123677d6", "content-length": "26", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37432024-12-16T21:03:16.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37442024-12-16T21:03:16.266ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37452024-12-16T21:03:16.266ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "963a9c45-aa5a-4de4-b519-2b1f03a9fa33", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37462024-12-16T21:03:16.266ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37472024-12-16T21:03:16.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37482024-12-16T21:03:16.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37492024-12-16T21:03:16.271ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6f16f1d4-2f92-4bd1-b5b1-9cca729ab32a", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37502024-12-16T21:03:16.271ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37512024-12-16T21:03:16.273ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37522024-12-16T21:03:16.273ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 306.640619ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37532024-12-16T21:03:16.273ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37542024-12-16T21:03:16.273ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37552024-12-16T21:03:16.273ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "84bc8781-8019-45bf-9504-bcced6bfdca0", "content-length": "372", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37562024-12-16T21:03:16.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37572024-12-16T21:03:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37582024-12-16T21:03:16.275ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c540d357-19a2-4dfb-b69f-8c72803bb72b dns_zone_name = oxide.test found_so_far = 1 version = 2
37592024-12-16T21:03:16.275ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37602024-12-16T21:03:16.276ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-16 20:50:36.849175 UTC dns_group = external generation = 2
37612024-12-16T21:03:16.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 308.335511ms iteration = 15 status = {"generation":2}
37622024-12-16T21:03:16.276ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 39bb6ad4-cf90-409c-ba70-fb0e4988ea0d dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
37632024-12-16T21:03:16.276ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
37642024-12-16T21:03:16.276ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-16 20:50:36.066577 UTC dns_group = internal generation = 1
37652024-12-16T21:03:16.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 309.671248ms iteration = 15 status = {"generation":1}
37662024-12-16T21:03:16.288ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37672024-12-16T21:03:16.288ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37682024-12-16T21:03:16.288ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1434133d-7edf-496b-a813-1d28bb8d3164", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37692024-12-16T21:03:16.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37702024-12-16T21:03:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37712024-12-16T21:03:16.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37722024-12-16T21:03:16.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37732024-12-16T21:03:16.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37742024-12-16T21:03:16.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37752024-12-16T21:03:16.298ZINFOnexus (BackgroundTasks): VPC route manager sled fcb8d596-df56-4771-9db0-b88ea87e1f94 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37762024-12-16T21:03:16.298ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37772024-12-16T21:03:16.298ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8441ab54-ba6b-48b9-a917-33379539979c", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37782024-12-16T21:03:16.300ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 333.136895ms iteration = 29 status = {}
37792024-12-16T21:03:16.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37802024-12-16T21:03:16.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37812024-12-16T21:03:16.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37822024-12-16T21:03:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37832024-12-16T21:03:16.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842024-12-16T21:03:16.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37852024-12-16T21:03:16.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37862024-12-16T21:03:16.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37872024-12-16T21:03:16.364ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37882024-12-16T21:03:16.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ce0f0abf-18fb-41fe-ba47-34147d7a64c8", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37892024-12-16T21:03:16.364ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37902024-12-16T21:03:16.367ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e939de47-0bba-4ada-816a-972a06e9bba0", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37912024-12-16T21:03:16.367ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37922024-12-16T21:03:16.369ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "15a3bf9f-f97a-4660-9fb8-0adfc8fe3345", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37932024-12-16T21:03:16.369ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37942024-12-16T21:03:16.371ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37952024-12-16T21:03:16.371ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 405.132111ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37962024-12-16T21:03:16.378ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 411.687726ms iteration = 27 status = {}
37972024-12-16T21:03:16.552ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37982024-12-16T21:03:16.553ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34283cca-85e0-4c3d-88a0-7d700eac8b8f", "content-length": "2", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
37992024-12-16T21:03:16.555ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38002024-12-16T21:03:16.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38012024-12-16T21:03:16.557ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 590.779208ms iteration = 27 status = null
38022024-12-16T21:03:16.607ZDEBGnexus (BackgroundTasks): client request SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38032024-12-16T21:03:16.607ZDEBGnexus (BackgroundTasks): client response SledAgent = fcb8d596-df56-4771-9db0-b88ea87e1f94 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a985587-03d3-4377-9a06-851909f666d7", "content-length": "691", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
38042024-12-16T21:03:16.607ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38052024-12-16T21:03:16.607ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38062024-12-16T21:03:16.607ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38072024-12-16T21:03:16.609ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 641.556678ms iteration = 28 status = {}
38082024-12-16T21:03:16.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38092024-12-16T21:03:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38102024-12-16T21:03:16.623ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 16fda06a-d39e-45ca-bd3f-905f50719871, rack_id: ffc1cbc2-5efd-4c07-97ec-1ad144477111, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d606f14-8c3f-4aaf-aa90-17d49ee535a0) } rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
38112024-12-16T21:03:16.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38122024-12-16T21:03:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38132024-12-16T21:03:16.632ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38142024-12-16T21:03:16.632ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f174b2e6-e505-40c1-bd51-417ef07a0cf3", "content-length": "134", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
38152024-12-16T21:03:16.632ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38162024-12-16T21:03:16.632ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d606f14-8c3f-4aaf-aa90-17d49ee535a0
38172024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38182024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38192024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38202024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38212024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38222024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38232024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38242024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38252024-12-16T21:03:16.633ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111
38262024-12-16T21:03:16.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38272024-12-16T21:03:16.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38282024-12-16T21:03:16.635ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38292024-12-16T21:03:16.635ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "193f42b1-09c2-4d18-bac1-422ef0515f6f", "content-length": "2", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
38302024-12-16T21:03:16.635ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38312024-12-16T21:03:16.635ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a00d2f38-9c1a-464d-8952-3b9748ecfde5", "content-length": "52", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
38322024-12-16T21:03:16.635ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch_location = Switch0
38332024-12-16T21:03:16.635ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38342024-12-16T21:03:16.734ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6fecda8c-fc15-4f06-9152-1a7c652e9d23", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
38352024-12-16T21:03:16.734ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 switch = Switch0
38362024-12-16T21:03:16.734ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38372024-12-16T21:03:16.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0bbb1364-7743-494e-b481-ffde094851e5 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38382024-12-16T21:03:16.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0bbb1364-7743-494e-b481-ffde094851e5 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38392024-12-16T21:03:16.734ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ffc1cbc2-5efd-4c07-97ec-1ad144477111 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "72b9bfed-defe-438e-9f8d-92cb42b5ee1c", "content-length": "682", "date": "Mon, 16 Dec 2024 21:03:16 GMT"} })
38402024-12-16T21:03:16.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38412024-12-16T21:03:16.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38422024-12-16T21:03:16.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0bbb1364-7743-494e-b481-ffde094851e5 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38432024-12-16T21:03:16.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38442024-12-16T21:03:16.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38452024-12-16T21:03:16.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38462024-12-16T21:03:16.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38472024-12-16T21:03:16.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38482024-12-16T21:03:16.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38492024-12-16T21:03:16.751ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 784.087752ms iteration = 27 status = {}
38502024-12-16T21:03:17.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 03820574-d232-4e61-8efb-307fdc46483b roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38512024-12-16T21:03:17.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 03820574-d232-4e61-8efb-307fdc46483b resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38522024-12-16T21:03:17.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 03820574-d232-4e61-8efb-307fdc46483b response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38532024-12-16T21:03:18.097ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60772
38542024-12-16T21:03:18.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60772 req_id = c6119c49-64b3-4637-b448-5fa119fec86f roles = RoleSet { roles: {} } uri = /metrics/producers
38552024-12-16T21:03:18.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60772 req_id = c6119c49-64b3-4637-b448-5fa119fec86f resource = Database result = Ok(()) uri = /metrics/producers
38562024-12-16T21:03:18.129ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 47a70e27-73d1-4499-a65e-1bb947c3cd95
38572024-12-16T21:03:18.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32438 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60772 req_id = c6119c49-64b3-4637-b448-5fa119fec86f response_code = 201 uri = /metrics/producers
38582024-12-16T21:03:18.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6cb38687-768e-436a-8b70-193f609db7fb roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38592024-12-16T21:03:18.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6cb38687-768e-436a-8b70-193f609db7fb resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38602024-12-16T21:03:18.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6cb38687-768e-436a-8b70-193f609db7fb response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38612024-12-16T21:03:19.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7a8ac89d-e59e-45c2-81f2-705032523860 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38622024-12-16T21:03:19.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7a8ac89d-e59e-45c2-81f2-705032523860 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38632024-12-16T21:03:19.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 7a8ac89d-e59e-45c2-81f2-705032523860 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38642024-12-16T21:03:20.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b350772-1a96-4f98-b5b6-2db1ae436674 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38652024-12-16T21:03:20.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b350772-1a96-4f98-b5b6-2db1ae436674 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38662024-12-16T21:03:20.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2b350772-1a96-4f98-b5b6-2db1ae436674 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38672024-12-16T21:03:21.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6624134d-4801-4a4d-8b6b-4a323a19eb91 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38682024-12-16T21:03:21.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6624134d-4801-4a4d-8b6b-4a323a19eb91 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38692024-12-16T21:03:21.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 6624134d-4801-4a4d-8b6b-4a323a19eb91 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38702024-12-16T21:03:22.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 2002b078-6ff3-476e-85b7-8375b0c9b825 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
38712024-12-16T21:03:22.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4393e9a0-198e-4cd1-b604-eaac303f88b5 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38722024-12-16T21:03:22.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4393e9a0-198e-4cd1-b604-eaac303f88b5 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38732024-12-16T21:03:22.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 4393e9a0-198e-4cd1-b604-eaac303f88b5 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38742024-12-16T21:03:23.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc041c11-3aa4-4f54-9658-0a1d1b8acf37 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38752024-12-16T21:03:23.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc041c11-3aa4-4f54-9658-0a1d1b8acf37 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38762024-12-16T21:03:23.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = dc041c11-3aa4-4f54-9658-0a1d1b8acf37 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38772024-12-16T21:03:24.341ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52646
38782024-12-16T21:03:24.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52646 req_id = f6876b9b-fb5e-40b6-94b9-59dc61c8cd55 roles = RoleSet { roles: {} } uri = /metrics/producers
38792024-12-16T21:03:24.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52646 req_id = f6876b9b-fb5e-40b6-94b9-59dc61c8cd55 resource = Database result = Ok(()) uri = /metrics/producers
38802024-12-16T21:03:24.381ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = 1cd69a2a-1479-41ed-8e5f-7f5ded9cc538
38812024-12-16T21:03:24.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39558 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52646 req_id = f6876b9b-fb5e-40b6-94b9-59dc61c8cd55 response_code = 201 uri = /metrics/producers
38822024-12-16T21:03:24.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2c0f444a-a6ea-42c0-b76e-1f5e1007db67 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38832024-12-16T21:03:24.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2c0f444a-a6ea-42c0-b76e-1f5e1007db67 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38842024-12-16T21:03:24.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 2c0f444a-a6ea-42c0-b76e-1f5e1007db67 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38852024-12-16T21:03:25.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 24521161-2bba-4cfb-a7b6-f5e578d67aed roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38862024-12-16T21:03:25.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 24521161-2bba-4cfb-a7b6-f5e578d67aed resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38872024-12-16T21:03:25.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 24521161-2bba-4cfb-a7b6-f5e578d67aed response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
38882024-12-16T21:03:25.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
38892024-12-16T21:03:25.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38902024-12-16T21:03:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38912024-12-16T21:03:25.967ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
38922024-12-16T21:03:25.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38932024-12-16T21:03:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38942024-12-16T21:03:25.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38952024-12-16T21:03:25.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38962024-12-16T21:03:25.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38972024-12-16T21:03:25.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38982024-12-16T21:03:25.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38992024-12-16T21:03:25.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39002024-12-16T21:03:25.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012024-12-16T21:03:25.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
39022024-12-16T21:03:25.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39032024-12-16T21:03:25.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39042024-12-16T21:03:25.990ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
39052024-12-16T21:03:25.990ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.031909ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
39062024-12-16T21:03:25.997ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39072024-12-16T21:03:25.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39082024-12-16T21:03:26.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.912746ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39092024-12-16T21:03:26.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fb7e5af9-c5b8-4643-acfe-934635afaf03 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39102024-12-16T21:03:26.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fb7e5af9-c5b8-4643-acfe-934635afaf03 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39112024-12-16T21:03:26.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = fb7e5af9-c5b8-4643-acfe-934635afaf03 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39122024-12-16T21:03:27.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = e90d7d29-5a15-4e04-9809-078805ec3acb roles = RoleSet { roles: {} } uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?sort_by=id_ascending
39132024-12-16T21:03:27.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = e90d7d29-5a15-4e04-9809-078805ec3acb resource = Database result = Ok(()) uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?sort_by=id_ascending
39142024-12-16T21:03:27.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = e90d7d29-5a15-4e04-9809-078805ec3acb response_code = 200 uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?sort_by=id_ascending
39152024-12-16T21:03:27.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 84333119-2afd-40ce-8dee-0faf670a1718 roles = RoleSet { roles: {} } uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2I4ZDU5Ni1kZjU2LTQ3NzEtOWRiMC1iODhlYTg3ZTFmOTQifX0%3D
39162024-12-16T21:03:27.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 84333119-2afd-40ce-8dee-0faf670a1718 resource = Database result = Ok(()) uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2I4ZDU5Ni1kZjU2LTQ3NzEtOWRiMC1iODhlYTg3ZTFmOTQifX0%3D
39172024-12-16T21:03:27.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56743 req_id = 84333119-2afd-40ce-8dee-0faf670a1718 response_code = 200 uri = /metrics/collectors/f46579df-689f-4e4e-aaac-884ca45dc7bb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2I4ZDU5Ni1kZjU2LTQ3NzEtOWRiMC1iODhlYTg3ZTFmOTQifX0%3D
39182024-12-16T21:03:27.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 403e3482-c690-4f9e-9083-5d6e4e1ccb54 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39192024-12-16T21:03:27.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 403e3482-c690-4f9e-9083-5d6e4e1ccb54 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39202024-12-16T21:03:27.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 403e3482-c690-4f9e-9083-5d6e4e1ccb54 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39212024-12-16T21:03:28.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f3d8ceb9-ef89-45e4-9920-1447ba69dc36 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39222024-12-16T21:03:28.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f3d8ceb9-ef89-45e4-9920-1447ba69dc36 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39232024-12-16T21:03:28.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = f3d8ceb9-ef89-45e4-9920-1447ba69dc36 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39242024-12-16T21:03:30.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bf56e158-f938-466c-b5df-880eccd51a26 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39252024-12-16T21:03:30.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bf56e158-f938-466c-b5df-880eccd51a26 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39262024-12-16T21:03:30.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = bf56e158-f938-466c-b5df-880eccd51a26 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39272024-12-16T21:03:30.221ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:56753
39282024-12-16T21:03:30.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56753 req_id = 8fbd167e-38d0-4798-86c7-76444cdbb0d0 roles = RoleSet { roles: {} } uri = /metrics/producers
39292024-12-16T21:03:30.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56753 req_id = 8fbd167e-38d0-4798-86c7-76444cdbb0d0 resource = Database result = Ok(()) uri = /metrics/producers
39302024-12-16T21:03:30.233ZINFOnexus: assigned collector to new producer collector_id = f46579df-689f-4e4e-aaac-884ca45dc7bb file = nexus/src/app/oximeter.rs:76 producer_id = fcb8d596-df56-4771-9db0-b88ea87e1f94
39312024-12-16T21:03:30.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11967 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56753 req_id = 8fbd167e-38d0-4798-86c7-76444cdbb0d0 response_code = 201 uri = /metrics/producers
39322024-12-16T21:03:31.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aa7770d1-e90c-4fdd-b30e-6905b42f81f7 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39332024-12-16T21:03:31.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aa7770d1-e90c-4fdd-b30e-6905b42f81f7 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39342024-12-16T21:03:31.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = aa7770d1-e90c-4fdd-b30e-6905b42f81f7 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39352024-12-16T21:03:32.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 17df2c75-a3b0-4f44-b913-3ffb9ac6bce2 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39362024-12-16T21:03:32.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 17df2c75-a3b0-4f44-b913-3ffb9ac6bce2 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39372024-12-16T21:03:32.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 17df2c75-a3b0-4f44-b913-3ffb9ac6bce2 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39382024-12-16T21:03:32.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1507 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 33198d08-3223-4f1e-98a9-1e3e67e62be1 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
39392024-12-16T21:03:33.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9a6a5afd-abf4-42cf-862a-eb4a7165b754 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39402024-12-16T21:03:33.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9a6a5afd-abf4-42cf-862a-eb4a7165b754 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39412024-12-16T21:03:33.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 9a6a5afd-abf4-42cf-862a-eb4a7165b754 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39422024-12-16T21:03:34.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 98219be2-5303-41d1-bc64-c59a9d9830d2 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39432024-12-16T21:03:34.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 98219be2-5303-41d1-bc64-c59a9d9830d2 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39442024-12-16T21:03:34.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 98219be2-5303-41d1-bc64-c59a9d9830d2 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39452024-12-16T21:03:35.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1b6b0326-c3d2-47dc-b1ce-481567cfaac4 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39462024-12-16T21:03:35.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1b6b0326-c3d2-47dc-b1ce-481567cfaac4 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39472024-12-16T21:03:35.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 1b6b0326-c3d2-47dc-b1ce-481567cfaac4 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39482024-12-16T21:03:35.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 92e9c45d-1bcd-48ef-9ec1-c4f81f1949fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
39492024-12-16T21:03:35.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 92e9c45d-1bcd-48ef-9ec1-c4f81f1949fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
39502024-12-16T21:03:35.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41768 req_id = 92e9c45d-1bcd-48ef-9ec1-c4f81f1949fe response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
39512024-12-16T21:03:35.966ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
39522024-12-16T21:03:35.966ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
39532024-12-16T21:03:35.966ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39542024-12-16T21:03:35.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39552024-12-16T21:03:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39562024-12-16T21:03:35.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39572024-12-16T21:03:35.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582024-12-16T21:03:35.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39592024-12-16T21:03:35.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39602024-12-16T21:03:35.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.644078ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39612024-12-16T21:03:35.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39622024-12-16T21:03:35.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39632024-12-16T21:03:35.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39642024-12-16T21:03:35.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39652024-12-16T21:03:35.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39662024-12-16T21:03:35.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672024-12-16T21:03:35.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5ad8c160-d0af-4a23-9f8b-a393662e3546, lookup_type: ById(5ad8c160-d0af-4a23-9f8b-a393662e3546) } result = Ok(())
39682024-12-16T21:03:35.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39692024-12-16T21:03:35.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39702024-12-16T21:03:35.988ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 original_time_created = 2024-12-16 20:49:58.299054 UTC target_id = 5ad8c160-d0af-4a23-9f8b-a393662e3546 time_created = 2024-12-16 20:49:58.299054 UTC
39712024-12-16T21:03:35.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.46128ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5ad8c160-d0af-4a23-9f8b-a393662e3546","time_created":"2024-12-16T20:49:58.299054Z"}
39722024-12-16T21:03:36.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e86d1df8-d248-4d32-9c4d-41ae952f5a64 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39732024-12-16T21:03:36.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e86d1df8-d248-4d32-9c4d-41ae952f5a64 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39742024-12-16T21:03:36.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e86d1df8-d248-4d32-9c4d-41ae952f5a64 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39752024-12-16T21:03:37.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0c820934-5f6c-4072-b44c-4a3026438010 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39762024-12-16T21:03:37.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0c820934-5f6c-4072-b44c-4a3026438010 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39772024-12-16T21:03:37.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 0c820934-5f6c-4072-b44c-4a3026438010 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39782024-12-16T21:03:38.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b6e8ab91-562d-499a-82ad-3e853e0bc1ac roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39792024-12-16T21:03:38.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b6e8ab91-562d-499a-82ad-3e853e0bc1ac resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39802024-12-16T21:03:38.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = b6e8ab91-562d-499a-82ad-3e853e0bc1ac response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39812024-12-16T21:03:39.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8b8dc424-7094-4c90-a49f-1f451caf5a06 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39822024-12-16T21:03:39.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8b8dc424-7094-4c90-a49f-1f451caf5a06 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39832024-12-16T21:03:39.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 8b8dc424-7094-4c90-a49f-1f451caf5a06 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39842024-12-16T21:03:40.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02d3b42d-380d-481f-a385-43e405983d85 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39852024-12-16T21:03:40.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02d3b42d-380d-481f-a385-43e405983d85 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39862024-12-16T21:03:40.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 02d3b42d-380d-481f-a385-43e405983d85 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39872024-12-16T21:03:41.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e2cae641-eb49-48cc-ae96-368cb443c054 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39882024-12-16T21:03:41.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e2cae641-eb49-48cc-ae96-368cb443c054 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39892024-12-16T21:03:41.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = e2cae641-eb49-48cc-ae96-368cb443c054 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39902024-12-16T21:03:42.186ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:53726 method = GET remote_addr = [fd00:1122:3344:101::d]:33469 req_id = 75681628-81e2-4ec2-983a-0f68be973294 response_code = 200 uri = /4f2a25cf-aa37-45f1-a807-f2e6efbd4fa4
39912024-12-16T21:03:42.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 20e6f2f0-11e0-415c-90b3-87cbbdb2658e roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39922024-12-16T21:03:42.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 20e6f2f0-11e0-415c-90b3-87cbbdb2658e resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39932024-12-16T21:03:42.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 20e6f2f0-11e0-415c-90b3-87cbbdb2658e response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39942024-12-16T21:03:43.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 74874d6c-f8cc-40f1-a576-a5fd5538fbcd roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39952024-12-16T21:03:43.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 74874d6c-f8cc-40f1-a576-a5fd5538fbcd resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39962024-12-16T21:03:43.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 74874d6c-f8cc-40f1-a576-a5fd5538fbcd response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39972024-12-16T21:03:44.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a8f872b-d8a7-4f0a-baf1-d59454db44a8 roles = RoleSet { roles: {} } uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39982024-12-16T21:03:44.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a8f872b-d8a7-4f0a-baf1-d59454db44a8 resource = Database result = Ok(()) uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94
39992024-12-16T21:03:44.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35687 req_id = 5a8f872b-d8a7-4f0a-baf1-d59454db44a8 response_code = 200 uri = /probes/fcb8d596-df56-4771-9db0-b88ea87e1f94