Max level shown:
12024-12-06T02:45:03.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebd7340c-a1ad-475f-859e-1a5c97fc49ae roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
22024-12-06T02:45:03.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebd7340c-a1ad-475f-859e-1a5c97fc49ae resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32024-12-06T02:45:03.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebd7340c-a1ad-475f-859e-1a5c97fc49ae response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42024-12-06T02:45:04.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c6116525-72fa-4582-8917-2817be04af33 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52024-12-06T02:45:04.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c6116525-72fa-4582-8917-2817be04af33 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
62024-12-06T02:45:04.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c6116525-72fa-4582-8917-2817be04af33 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72024-12-06T02:45:05.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1376 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 4c9b253d-27dc-49ab-961c-94977e6a840b response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
82024-12-06T02:45:05.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4c0499d0-620a-4581-b0cb-81c955bc44ad roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
92024-12-06T02:45:05.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4c0499d0-620a-4581-b0cb-81c955bc44ad resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
102024-12-06T02:45:05.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4c0499d0-620a-4581-b0cb-81c955bc44ad response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
112024-12-06T02:45:06.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e1832080-8afe-4eb1-bee1-73e927ea33f0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
122024-12-06T02:45:06.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e1832080-8afe-4eb1-bee1-73e927ea33f0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
132024-12-06T02:45:06.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e1832080-8afe-4eb1-bee1-73e927ea33f0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
142024-12-06T02:45:07.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ab13220-79e8-44e0-a3ea-3f3893fe5e7e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
152024-12-06T02:45:07.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ab13220-79e8-44e0-a3ea-3f3893fe5e7e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
162024-12-06T02:45:07.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ab13220-79e8-44e0-a3ea-3f3893fe5e7e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
172024-12-06T02:45:08.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57f3fe23-435c-4773-8f40-3348be49859b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
182024-12-06T02:45:08.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57f3fe23-435c-4773-8f40-3348be49859b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
192024-12-06T02:45:08.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57f3fe23-435c-4773-8f40-3348be49859b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
202024-12-06T02:45:09.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8b9c2708-b8af-46cb-a500-f5020c993e24 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
212024-12-06T02:45:09.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8b9c2708-b8af-46cb-a500-f5020c993e24 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
222024-12-06T02:45:09.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8b9c2708-b8af-46cb-a500-f5020c993e24 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
232024-12-06T02:45:10.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
242024-12-06T02:45:10.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
252024-12-06T02:45:10.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
262024-12-06T02:45:10.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
272024-12-06T02:45:10.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
282024-12-06T02:45:10.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-12-06T02:45:10.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
302024-12-06T02:45:10.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
312024-12-06T02:45:10.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
322024-12-06T02:45:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
332024-12-06T02:45:10.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
342024-12-06T02:45:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-12-06T02:45:10.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362024-12-06T02:45:10.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372024-12-06T02:45:10.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
382024-12-06T02:45:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
392024-12-06T02:45:10.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
402024-12-06T02:45:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
412024-12-06T02:45:10.120ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
422024-12-06T02:45:10.120ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.013842ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
432024-12-06T02:45:10.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.450619ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
442024-12-06T02:45:10.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dceb1ecd-2675-468b-ab96-c51af857d763 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
452024-12-06T02:45:10.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dceb1ecd-2675-468b-ab96-c51af857d763 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
462024-12-06T02:45:10.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dceb1ecd-2675-468b-ab96-c51af857d763 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
472024-12-06T02:45:11.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e2936b1c-8674-45b0-83ac-549ecf9b4796 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
482024-12-06T02:45:11.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e2936b1c-8674-45b0-83ac-549ecf9b4796 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
492024-12-06T02:45:11.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e2936b1c-8674-45b0-83ac-549ecf9b4796 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
502024-12-06T02:45:12.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f705d134-ba8c-4948-9262-6652c35f61e5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
512024-12-06T02:45:12.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f705d134-ba8c-4948-9262-6652c35f61e5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
522024-12-06T02:45:12.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f705d134-ba8c-4948-9262-6652c35f61e5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
532024-12-06T02:45:13.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e71e0b5-cbfb-44c5-b38e-fb0ac8bd2bff roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
542024-12-06T02:45:13.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e71e0b5-cbfb-44c5-b38e-fb0ac8bd2bff resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
552024-12-06T02:45:13.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e71e0b5-cbfb-44c5-b38e-fb0ac8bd2bff response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
562024-12-06T02:45:14.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 22c3f4fc-f8bd-4b21-abc9-ec17dd4f470f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
572024-12-06T02:45:14.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 22c3f4fc-f8bd-4b21-abc9-ec17dd4f470f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
582024-12-06T02:45:14.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 22c3f4fc-f8bd-4b21-abc9-ec17dd4f470f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
592024-12-06T02:45:15.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1282 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 6b15f3bb-ab21-4c1b-9b81-be34bf713ecd response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
602024-12-06T02:45:15.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 050a46ee-2695-44cb-a1db-0225624688af roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
612024-12-06T02:45:15.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 050a46ee-2695-44cb-a1db-0225624688af resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
622024-12-06T02:45:15.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 050a46ee-2695-44cb-a1db-0225624688af response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
632024-12-06T02:45:16.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = db4d71ce-5432-472d-8d3e-9d0498bf397b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
642024-12-06T02:45:16.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = db4d71ce-5432-472d-8d3e-9d0498bf397b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
652024-12-06T02:45:16.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = db4d71ce-5432-472d-8d3e-9d0498bf397b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
662024-12-06T02:45:17.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c565f013-8464-4d98-9dcb-d056f7c51fb9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
672024-12-06T02:45:17.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c565f013-8464-4d98-9dcb-d056f7c51fb9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
682024-12-06T02:45:17.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c565f013-8464-4d98-9dcb-d056f7c51fb9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
692024-12-06T02:45:18.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a48b12b9-cf6c-405f-aa80-2739068dd630 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
702024-12-06T02:45:18.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a48b12b9-cf6c-405f-aa80-2739068dd630 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
712024-12-06T02:45:18.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a48b12b9-cf6c-405f-aa80-2739068dd630 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
722024-12-06T02:45:19.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 693d305f-d66b-4b0f-98a8-3e676b3bb9d6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
732024-12-06T02:45:19.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 693d305f-d66b-4b0f-98a8-3e676b3bb9d6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
742024-12-06T02:45:19.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 693d305f-d66b-4b0f-98a8-3e676b3bb9d6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
752024-12-06T02:45:20.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
762024-12-06T02:45:20.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
772024-12-06T02:45:20.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
782024-12-06T02:45:20.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
792024-12-06T02:45:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
802024-12-06T02:45:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
812024-12-06T02:45:20.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
822024-12-06T02:45:20.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
832024-12-06T02:45:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
842024-12-06T02:45:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
852024-12-06T02:45:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862024-12-06T02:45:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872024-12-06T02:45:20.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
882024-12-06T02:45:20.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
892024-12-06T02:45:20.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
902024-12-06T02:45:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
912024-12-06T02:45:20.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
922024-12-06T02:45:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
932024-12-06T02:45:20.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
942024-12-06T02:45:20.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.671219ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
952024-12-06T02:45:20.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.753128ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
962024-12-06T02:45:20.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fba92e2e-1f98-41b1-94f6-f2a43b4f0702 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
972024-12-06T02:45:20.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fba92e2e-1f98-41b1-94f6-f2a43b4f0702 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
982024-12-06T02:45:20.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fba92e2e-1f98-41b1-94f6-f2a43b4f0702 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
992024-12-06T02:45:21.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d592bb77-ebaf-4293-8981-106ad3d6bb8f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1002024-12-06T02:45:21.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d592bb77-ebaf-4293-8981-106ad3d6bb8f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1012024-12-06T02:45:21.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d592bb77-ebaf-4293-8981-106ad3d6bb8f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1022024-12-06T02:45:22.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 36a811db-e95b-4a15-98d3-7aa54da69d2a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1032024-12-06T02:45:22.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 36a811db-e95b-4a15-98d3-7aa54da69d2a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1042024-12-06T02:45:22.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 36a811db-e95b-4a15-98d3-7aa54da69d2a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1052024-12-06T02:45:23.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e58e1e23-b289-431b-a2a4-8b4506a49dc0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1062024-12-06T02:45:23.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e58e1e23-b289-431b-a2a4-8b4506a49dc0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1072024-12-06T02:45:23.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e58e1e23-b289-431b-a2a4-8b4506a49dc0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1082024-12-06T02:45:24.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1216aa4b-b4a1-4bd3-95e7-11141481d7b0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1092024-12-06T02:45:24.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1216aa4b-b4a1-4bd3-95e7-11141481d7b0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1102024-12-06T02:45:24.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1216aa4b-b4a1-4bd3-95e7-11141481d7b0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1112024-12-06T02:45:25.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1196 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 16102773-71c5-4feb-8d65-5845ddaa4597 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
1122024-12-06T02:45:25.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a545ec1f-7729-4e88-a514-96af2223c1bf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1132024-12-06T02:45:25.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a545ec1f-7729-4e88-a514-96af2223c1bf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1142024-12-06T02:45:25.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a545ec1f-7729-4e88-a514-96af2223c1bf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1152024-12-06T02:45:26.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a83a48e-07f3-4b31-8919-9216d63be7c5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1162024-12-06T02:45:26.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a83a48e-07f3-4b31-8919-9216d63be7c5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1172024-12-06T02:45:26.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a83a48e-07f3-4b31-8919-9216d63be7c5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1182024-12-06T02:45:27.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 62d6cd05-dc80-4a49-8761-be5dcade02ff roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1192024-12-06T02:45:27.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 62d6cd05-dc80-4a49-8761-be5dcade02ff resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1202024-12-06T02:45:27.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 62d6cd05-dc80-4a49-8761-be5dcade02ff response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1212024-12-06T02:45:28.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c5b26bce-8013-4ff4-bd86-e4fcb6d6c4ec roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1222024-12-06T02:45:28.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c5b26bce-8013-4ff4-bd86-e4fcb6d6c4ec resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1232024-12-06T02:45:28.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c5b26bce-8013-4ff4-bd86-e4fcb6d6c4ec response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1242024-12-06T02:45:29.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c7905725-56c1-43ea-8158-ba2c767004bc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1252024-12-06T02:45:29.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c7905725-56c1-43ea-8158-ba2c767004bc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1262024-12-06T02:45:29.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c7905725-56c1-43ea-8158-ba2c767004bc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
1272024-12-06T02:45:30.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 539d7ef5-3dc1-4267-8ae2-a2bcfee2fd05 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
1282024-12-06T02:45:30.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 539d7ef5-3dc1-4267-8ae2-a2bcfee2fd05 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
1292024-12-06T02:45:30.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 539d7ef5-3dc1-4267-8ae2-a2bcfee2fd05 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
1302024-12-06T02:45:30.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 66828a15-4354-4d0c-b1af-4192e2d189e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
1312024-12-06T02:45:30.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 66828a15-4354-4d0c-b1af-4192e2d189e1 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
1322024-12-06T02:45:30.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 66828a15-4354-4d0c-b1af-4192e2d189e1 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
1332024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
1342024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
1352024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1362024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
1372024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1382024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1392024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
1402024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
1412024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1422024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1432024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
1442024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1452024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
1462024-12-06T02:45:30.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1472024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
1482024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1492024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1502024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
1512024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
1522024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1532024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
1542024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1552024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
1562024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1572024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1582024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
1592024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1602024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1612024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1622024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1632024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1642024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1652024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1662024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1672024-12-06T02:45:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1682024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1692024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1702024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1712024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1722024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
1732024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
1742024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1752024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1762024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
1772024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1782024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
1792024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1802024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1812024-12-06T02:45:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1822024-12-06T02:45:30.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1832024-12-06T02:45:30.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1842024-12-06T02:45:30.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1852024-12-06T02:45:30.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862024-12-06T02:45:30.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1872024-12-06T02:45:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1882024-12-06T02:45:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1892024-12-06T02:45:30.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1902024-12-06T02:45:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1912024-12-06T02:45:30.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1922024-12-06T02:45:30.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1932024-12-06T02:45:30.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1942024-12-06T02:45:30.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1952024-12-06T02:45:30.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1962024-12-06T02:45:30.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1972024-12-06T02:45:30.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1982024-12-06T02:45:30.122ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1992024-12-06T02:45:30.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5878, tv_nsec: 489894467 } })
2002024-12-06T02:45:30.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2012024-12-06T02:45:30.123ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
2022024-12-06T02:45:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2032024-12-06T02:45:30.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2042024-12-06T02:45:30.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2052024-12-06T02:45:30.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2062024-12-06T02:45:30.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2072024-12-06T02:45:30.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2082024-12-06T02:45:30.128ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5878, tv_nsec: 495720604 } })
2092024-12-06T02:45:30.129ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
2102024-12-06T02:45:30.129ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2112024-12-06T02:45:30.129ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2122024-12-06T02:45:30.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2132024-12-06T02:45:30.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.842006ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
2142024-12-06T02:45:30.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2152024-12-06T02:45:30.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2162024-12-06T02:45:30.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2172024-12-06T02:45:30.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2182024-12-06T02:45:30.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2192024-12-06T02:45:30.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2202024-12-06T02:45:30.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2212024-12-06T02:45:30.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2222024-12-06T02:45:30.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2232024-12-06T02:45:30.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2242024-12-06T02:45:30.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2252024-12-06T02:45:30.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.827974ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
2262024-12-06T02:45:30.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.458326ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2272024-12-06T02:45:30.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2282024-12-06T02:45:30.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2292024-12-06T02:45:30.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2302024-12-06T02:45:30.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2312024-12-06T02:45:30.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-12-06T02:45:30.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
2332024-12-06T02:45:30.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2342024-12-06T02:45:30.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2352024-12-06T02:45:30.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2362024-12-06T02:45:30.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2372024-12-06T02:45:30.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2382024-12-06T02:45:30.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2392024-12-06T02:45:30.193ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2402024-12-06T02:45:30.193ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2412024-12-06T02:45:30.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2422024-12-06T02:45:30.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2432024-12-06T02:45:30.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442024-12-06T02:45:30.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2452024-12-06T02:45:30.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2462024-12-06T02:45:30.196ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2472024-12-06T02:45:30.196ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2482024-12-06T02:45:30.196ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.744796ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2492024-12-06T02:45:30.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2502024-12-06T02:45:30.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2512024-12-06T02:45:30.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2522024-12-06T02:45:30.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2532024-12-06T02:45:30.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2542024-12-06T02:45:30.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2552024-12-06T02:45:30.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2562024-12-06T02:45:30.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.409072ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2572024-12-06T02:45:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
2582024-12-06T02:45:30.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2592024-12-06T02:45:30.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2602024-12-06T02:45:30.200ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5878, tv_nsec: 567037111 } })
2612024-12-06T02:45:30.200ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
2622024-12-06T02:45:30.201ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.841241ms iteration = 8 status = 0
2632024-12-06T02:45:30.209ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
2642024-12-06T02:45:30.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.787939ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
2652024-12-06T02:45:30.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 110.064763ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2662024-12-06T02:45:30.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2672024-12-06T02:45:30.215ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2682024-12-06T02:45:30.216ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5a7a850-c8bd-459d-b204-7f1a835598c7", "content-length": "26", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
2692024-12-06T02:45:30.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2702024-12-06T02:45:30.218ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2712024-12-06T02:45:30.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2722024-12-06T02:45:30.218ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732024-12-06T02:45:30.219ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0a265ed-36a4-48c1-adf0-5531a025960c", "content-length": "26", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
2742024-12-06T02:45:30.219ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752024-12-06T02:45:30.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2762024-12-06T02:45:30.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2772024-12-06T02:45:30.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2782024-12-06T02:45:30.237ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2792024-12-06T02:45:30.237ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2802024-12-06T02:45:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.948532ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2812024-12-06T02:45:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 134.81444ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2822024-12-06T02:45:30.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2832024-12-06T02:45:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2842024-12-06T02:45:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.741924ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2852024-12-06T02:45:30.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2862024-12-06T02:45:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2872024-12-06T02:45:30.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882024-12-06T02:45:30.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2892024-12-06T02:45:30.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2902024-12-06T02:45:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2912024-12-06T02:45:30.279ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
2922024-12-06T02:45:30.279ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2932024-12-06T02:45:30.279ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2fe8fdb-683c-4a9c-85b1-f7354860864d", "content-length": "26", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
2942024-12-06T02:45:30.279ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2952024-12-06T02:45:30.281ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
2962024-12-06T02:45:30.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-12-06T02:45:30.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2982024-12-06T02:45:30.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2992024-12-06T02:45:30.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3002024-12-06T02:45:30.325ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3012024-12-06T02:45:30.325ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "88ed7c38-664d-4d9a-89cf-62407a6c957b", "content-length": "1", "date": "Fri, 06 Dec 2024 02:45:29 GMT"} })
3022024-12-06T02:45:30.327ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3032024-12-06T02:45:30.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3042024-12-06T02:45:30.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.355624ms iteration = 11 status = {"physical_disks_added":0}
3052024-12-06T02:45:30.331ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.36045ms iteration = 8 status = {}
3062024-12-06T02:45:30.388ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3072024-12-06T02:45:30.388ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3082024-12-06T02:45:30.388ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd27f1a7-122d-4306-8366-ceb2404f3f1b", "content-length": "372", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
3092024-12-06T02:45:30.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3102024-12-06T02:45:30.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3112024-12-06T02:45:30.390ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 289.55224ms iteration = 8 status = null
3122024-12-06T02:45:30.446ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3132024-12-06T02:45:30.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3142024-12-06T02:45:30.446ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b8d79787-898f-4526-ba3b-d1da0a03cf15", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
3152024-12-06T02:45:30.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3162024-12-06T02:45:30.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3172024-12-06T02:45:30.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3182024-12-06T02:45:30.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3192024-12-06T02:45:30.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3202024-12-06T02:45:30.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3212024-12-06T02:45:30.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3222024-12-06T02:45:30.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3232024-12-06T02:45:30.471ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
3242024-12-06T02:45:30.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3252024-12-06T02:45:30.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3262024-12-06T02:45:30.486ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3272024-12-06T02:45:30.487ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b43b7c-5d8f-46ea-829d-87978050c29a", "content-length": "134", "date": "Fri, 06 Dec 2024 02:45:29 GMT"} })
3282024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3292024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
3302024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3312024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3322024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3332024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3342024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3352024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3362024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3372024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3382024-12-06T02:45:30.487ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
3392024-12-06T02:45:30.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3402024-12-06T02:45:30.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3412024-12-06T02:45:30.496ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3422024-12-06T02:45:30.496ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "99b0d56b-7c04-4a13-9fed-7d04bc8a18c1", "content-length": "691", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
3432024-12-06T02:45:30.496ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3442024-12-06T02:45:30.496ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3452024-12-06T02:45:30.496ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3462024-12-06T02:45:30.497ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 396.539516ms iteration = 8 status = {}
3472024-12-06T02:45:30.498ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3482024-12-06T02:45:30.498ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "699adffe-b91c-4c1e-84a6-26b2d16ef145", "content-length": "2", "date": "Fri, 06 Dec 2024 02:45:29 GMT"} })
3492024-12-06T02:45:30.498ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3502024-12-06T02:45:30.498ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "118ae567-c47b-400e-a3b8-9e74f0f71b41", "content-length": "52", "date": "Fri, 06 Dec 2024 02:45:29 GMT"} })
3512024-12-06T02:45:30.498ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
3522024-12-06T02:45:30.498ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3532024-12-06T02:45:30.544ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3542024-12-06T02:45:30.544ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3552024-12-06T02:45:30.598ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c3628308-82b6-4574-b512-0d57f9067b65", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
3562024-12-06T02:45:30.598ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
3572024-12-06T02:45:30.598ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3582024-12-06T02:45:30.599ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "25baac9a-3b50-403b-b91f-be4224b2f1e1", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
3592024-12-06T02:45:30.600ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 498.973442ms iteration = 9 status = {}
3602024-12-06T02:45:30.600ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6d24923-ea66-45cc-9cb9-788666ccf4dd", "content-length": "682", "date": "Fri, 06 Dec 2024 02:45:30 GMT"} })
3612024-12-06T02:45:30.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3622024-12-06T02:45:30.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3632024-12-06T02:45:30.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3642024-12-06T02:45:30.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3652024-12-06T02:45:30.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3662024-12-06T02:45:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3672024-12-06T02:45:30.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3682024-12-06T02:45:30.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3692024-12-06T02:45:30.617ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 516.217954ms iteration = 8 status = {}
3702024-12-06T02:45:30.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cabf6a96-c5bb-45ae-ab88-8ff5045bca5c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3712024-12-06T02:45:30.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cabf6a96-c5bb-45ae-ab88-8ff5045bca5c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3722024-12-06T02:45:30.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cabf6a96-c5bb-45ae-ab88-8ff5045bca5c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3732024-12-06T02:45:31.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 1148affd-eb7b-467e-8d91-65fc792df895 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3742024-12-06T02:45:31.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 1148affd-eb7b-467e-8d91-65fc792df895 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3752024-12-06T02:45:31.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 1148affd-eb7b-467e-8d91-65fc792df895 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3762024-12-06T02:45:31.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f834d598-ad46-4ecf-b938-38e2a996f5a0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3772024-12-06T02:45:31.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f834d598-ad46-4ecf-b938-38e2a996f5a0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3782024-12-06T02:45:31.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f834d598-ad46-4ecf-b938-38e2a996f5a0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3792024-12-06T02:45:32.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c0095c10-0ddd-452b-a1ad-beb56dd8eaf0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3802024-12-06T02:45:32.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c0095c10-0ddd-452b-a1ad-beb56dd8eaf0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3812024-12-06T02:45:32.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c0095c10-0ddd-452b-a1ad-beb56dd8eaf0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3822024-12-06T02:45:33.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8d111190-041f-4d5c-9f99-956a8dbcff88 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3832024-12-06T02:45:33.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8d111190-041f-4d5c-9f99-956a8dbcff88 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3842024-12-06T02:45:33.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8d111190-041f-4d5c-9f99-956a8dbcff88 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3852024-12-06T02:45:34.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 08de2455-9aaa-4249-8041-fb346ac940dd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3862024-12-06T02:45:34.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 08de2455-9aaa-4249-8041-fb346ac940dd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3872024-12-06T02:45:34.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 08de2455-9aaa-4249-8041-fb346ac940dd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3882024-12-06T02:45:35.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1416 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 19e47006-3d5c-4557-ba83-5e7d5ab22467 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
3892024-12-06T02:45:36.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f21790e0-ea6b-43bf-b039-b25380e240c8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3902024-12-06T02:45:36.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f21790e0-ea6b-43bf-b039-b25380e240c8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3912024-12-06T02:45:36.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f21790e0-ea6b-43bf-b039-b25380e240c8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3922024-12-06T02:45:37.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8008116b-dfa8-42e7-b127-c35c1476da25 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3932024-12-06T02:45:37.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8008116b-dfa8-42e7-b127-c35c1476da25 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3942024-12-06T02:45:37.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8008116b-dfa8-42e7-b127-c35c1476da25 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3952024-12-06T02:45:38.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c48158f3-82a7-4fb5-a044-1bd66be2ec99 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3962024-12-06T02:45:38.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c48158f3-82a7-4fb5-a044-1bd66be2ec99 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3972024-12-06T02:45:38.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c48158f3-82a7-4fb5-a044-1bd66be2ec99 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3982024-12-06T02:45:39.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = edeb09b7-dc2c-4554-91a9-0631fff7106f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
3992024-12-06T02:45:39.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = edeb09b7-dc2c-4554-91a9-0631fff7106f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4002024-12-06T02:45:39.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = edeb09b7-dc2c-4554-91a9-0631fff7106f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4012024-12-06T02:45:40.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e62c769f-0c64-4b97-ad3b-e348e4742ede roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4022024-12-06T02:45:40.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e62c769f-0c64-4b97-ad3b-e348e4742ede resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4032024-12-06T02:45:40.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e62c769f-0c64-4b97-ad3b-e348e4742ede response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4042024-12-06T02:45:40.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
4052024-12-06T02:45:40.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
4062024-12-06T02:45:40.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4072024-12-06T02:45:40.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4082024-12-06T02:45:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4092024-12-06T02:45:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4102024-12-06T02:45:40.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-12-06T02:45:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4122024-12-06T02:45:40.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4132024-12-06T02:45:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4142024-12-06T02:45:40.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4152024-12-06T02:45:40.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4162024-12-06T02:45:40.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4172024-12-06T02:45:40.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
4182024-12-06T02:45:40.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4192024-12-06T02:45:40.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4202024-12-06T02:45:40.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
4212024-12-06T02:45:40.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.141614ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
4222024-12-06T02:45:40.129ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4232024-12-06T02:45:40.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4242024-12-06T02:45:40.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.712629ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4252024-12-06T02:45:41.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 789683f5-2ec7-45e9-a8c5-cb0d8f750583 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4262024-12-06T02:45:41.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 789683f5-2ec7-45e9-a8c5-cb0d8f750583 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4272024-12-06T02:45:41.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 789683f5-2ec7-45e9-a8c5-cb0d8f750583 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4282024-12-06T02:45:42.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b76449ee-4180-463a-a6db-8ebd5b2eb0c3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4292024-12-06T02:45:42.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b76449ee-4180-463a-a6db-8ebd5b2eb0c3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4302024-12-06T02:45:42.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b76449ee-4180-463a-a6db-8ebd5b2eb0c3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4312024-12-06T02:45:43.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0b3abedf-21df-422e-a374-5b27064ad990 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4322024-12-06T02:45:43.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0b3abedf-21df-422e-a374-5b27064ad990 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4332024-12-06T02:45:43.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0b3abedf-21df-422e-a374-5b27064ad990 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4342024-12-06T02:45:44.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2135fb73-c3de-4b42-8f68-4ad27f2abbe4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4352024-12-06T02:45:44.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2135fb73-c3de-4b42-8f68-4ad27f2abbe4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4362024-12-06T02:45:44.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2135fb73-c3de-4b42-8f68-4ad27f2abbe4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4372024-12-06T02:45:45.027ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1372 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 7e7d87a1-650e-447e-8342-96b986cef071 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
4382024-12-06T02:45:45.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 596618c0-9e30-4fb1-b6de-f8b89ca84ef3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4392024-12-06T02:45:45.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 596618c0-9e30-4fb1-b6de-f8b89ca84ef3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4402024-12-06T02:45:45.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 596618c0-9e30-4fb1-b6de-f8b89ca84ef3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4412024-12-06T02:45:46.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 91519a39-e56f-4cc6-8f03-d4df3200965c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4422024-12-06T02:45:46.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 91519a39-e56f-4cc6-8f03-d4df3200965c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4432024-12-06T02:45:46.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 91519a39-e56f-4cc6-8f03-d4df3200965c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4442024-12-06T02:45:47.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ecfe661e-d59d-4b31-94ab-da76f683ff69 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4452024-12-06T02:45:47.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ecfe661e-d59d-4b31-94ab-da76f683ff69 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4462024-12-06T02:45:47.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ecfe661e-d59d-4b31-94ab-da76f683ff69 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4472024-12-06T02:45:48.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb0165bf-5caf-4c15-ae36-ce56c3bd87f4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4482024-12-06T02:45:48.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb0165bf-5caf-4c15-ae36-ce56c3bd87f4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4492024-12-06T02:45:48.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb0165bf-5caf-4c15-ae36-ce56c3bd87f4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4502024-12-06T02:45:49.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 203ef416-967e-42d4-bc72-12cf579190f8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4512024-12-06T02:45:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 203ef416-967e-42d4-bc72-12cf579190f8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4522024-12-06T02:45:49.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 203ef416-967e-42d4-bc72-12cf579190f8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4532024-12-06T02:45:50.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
4542024-12-06T02:45:50.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
4552024-12-06T02:45:50.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4562024-12-06T02:45:50.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4572024-12-06T02:45:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4582024-12-06T02:45:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4592024-12-06T02:45:50.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4602024-12-06T02:45:50.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4612024-12-06T02:45:50.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4622024-12-06T02:45:50.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.050046ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4632024-12-06T02:45:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4642024-12-06T02:45:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4652024-12-06T02:45:50.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4662024-12-06T02:45:50.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672024-12-06T02:45:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4682024-12-06T02:45:50.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4692024-12-06T02:45:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
4702024-12-06T02:45:50.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4712024-12-06T02:45:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4722024-12-06T02:45:50.118ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
4732024-12-06T02:45:50.118ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.13078ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
4742024-12-06T02:45:50.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9ab94245-0ed2-4471-a9fb-908e61842b63 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4752024-12-06T02:45:50.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9ab94245-0ed2-4471-a9fb-908e61842b63 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4762024-12-06T02:45:50.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9ab94245-0ed2-4471-a9fb-908e61842b63 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4772024-12-06T02:45:51.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4c84bb3e-faf6-4aa0-9739-e760914b2cc8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4782024-12-06T02:45:51.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4c84bb3e-faf6-4aa0-9739-e760914b2cc8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4792024-12-06T02:45:51.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4c84bb3e-faf6-4aa0-9739-e760914b2cc8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4802024-12-06T02:45:52.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = efa4aad8-3b14-450d-b0d6-31c2cbce769d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4812024-12-06T02:45:52.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = efa4aad8-3b14-450d-b0d6-31c2cbce769d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4822024-12-06T02:45:52.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = efa4aad8-3b14-450d-b0d6-31c2cbce769d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4832024-12-06T02:45:53.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57982e7d-0a43-49fe-9b79-e46c2216bfed roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4842024-12-06T02:45:53.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57982e7d-0a43-49fe-9b79-e46c2216bfed resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4852024-12-06T02:45:53.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57982e7d-0a43-49fe-9b79-e46c2216bfed response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4862024-12-06T02:45:54.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab76fe83-5958-4239-b166-fd8b5baf7531 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4872024-12-06T02:45:54.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab76fe83-5958-4239-b166-fd8b5baf7531 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4882024-12-06T02:45:54.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab76fe83-5958-4239-b166-fd8b5baf7531 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4892024-12-06T02:45:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1205 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = d6d6dc58-985c-4e7b-81a9-1110505b30be response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
4902024-12-06T02:45:55.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64783188-ba64-4659-a715-ab66b904027c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4912024-12-06T02:45:55.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64783188-ba64-4659-a715-ab66b904027c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4922024-12-06T02:45:55.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64783188-ba64-4659-a715-ab66b904027c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4932024-12-06T02:45:56.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e43a552a-2aed-45eb-ad36-6483206903fb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4942024-12-06T02:45:56.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e43a552a-2aed-45eb-ad36-6483206903fb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4952024-12-06T02:45:56.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e43a552a-2aed-45eb-ad36-6483206903fb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4962024-12-06T02:45:57.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 42e4116c-7bd0-4af9-aabd-04142a72f51b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4972024-12-06T02:45:57.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 42e4116c-7bd0-4af9-aabd-04142a72f51b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4982024-12-06T02:45:57.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 42e4116c-7bd0-4af9-aabd-04142a72f51b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
4992024-12-06T02:45:58.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed1cdd1c-a14e-4923-9845-03518a663ae5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
5002024-12-06T02:45:58.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed1cdd1c-a14e-4923-9845-03518a663ae5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
5012024-12-06T02:45:58.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed1cdd1c-a14e-4923-9845-03518a663ae5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
5022024-12-06T02:45:59.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 99e2e7a7-bcbb-425c-aad8-00c28f426927 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
5032024-12-06T02:45:59.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 99e2e7a7-bcbb-425c-aad8-00c28f426927 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
5042024-12-06T02:45:59.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 99e2e7a7-bcbb-425c-aad8-00c28f426927 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
5052024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
5062024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5072024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
5082024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5092024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
5102024-12-06T02:46:00.102ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5112024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5122024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
5132024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
5142024-12-06T02:46:00.102ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
5152024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.831\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
5162024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
5172024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
5182024-12-06T02:46:00.102ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5192024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5202024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
5212024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5222024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5232024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5242024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
5252024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
5262024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
5272024-12-06T02:46:00.102ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:36:00.102310405 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5282024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
5292024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5302024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5312024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
5322024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5332024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
5342024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5352024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
5362024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5372024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
5382024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5392024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
5402024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5412024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5422024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
5432024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5442024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
5452024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5462024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
5472024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5482024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
5492024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
5502024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5512024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
5522024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5532024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
5542024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5552024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5562024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5572024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5582024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5592024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5602024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
5612024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
5622024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5632024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5642024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
5652024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
5662024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5672024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5682024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5692024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
5702024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
5712024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5722024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5732024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5742024-12-06T02:46:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5752024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5762024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5772024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5782024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5792024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5802024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5812024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5822024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5832024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5842024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5852024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5862024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5872024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5882024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5892024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5902024-12-06T02:46:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5912024-12-06T02:46:00.103ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 5908, tv_nsec: 470266366 } })
5922024-12-06T02:46:00.103ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5908, tv_nsec: 470286557 } })
5932024-12-06T02:46:00.104ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5942024-12-06T02:46:00.104ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.058979ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5952024-12-06T02:46:00.104ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
5962024-12-06T02:46:00.104ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.770101ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5972024-12-06T02:46:00.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-12-06T02:46:00.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992024-12-06T02:46:00.113ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-12-06T02:46:00.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6012024-12-06T02:46:00.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6022024-12-06T02:46:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6032024-12-06T02:46:00.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6042024-12-06T02:46:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6052024-12-06T02:46:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6062024-12-06T02:46:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6072024-12-06T02:46:00.116ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6082024-12-06T02:46:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6092024-12-06T02:46:00.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6102024-12-06T02:46:00.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6112024-12-06T02:46:00.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-12-06T02:46:00.133ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132024-12-06T02:46:00.134ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5908, tv_nsec: 501820798 } })
6142024-12-06T02:46:00.135ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:36:00.102310405 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6152024-12-06T02:46:00.135ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 32.753216ms iteration = 5 status = {"expiration":"2024-12-06T02:36:00.102310405Z","pruned":[]}
6162024-12-06T02:46:00.135ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6172024-12-06T02:46:00.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6182024-12-06T02:46:00.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6192024-12-06T02:46:00.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6202024-12-06T02:46:00.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6212024-12-06T02:46:00.136ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6222024-12-06T02:46:00.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6232024-12-06T02:46:00.136ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 34.275519ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6242024-12-06T02:46:00.141ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6252024-12-06T02:46:00.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6262024-12-06T02:46:00.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6272024-12-06T02:46:00.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6282024-12-06T02:46:00.144ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5908, tv_nsec: 511485804 } })
6292024-12-06T02:46:00.145ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
6302024-12-06T02:46:00.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6312024-12-06T02:46:00.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6322024-12-06T02:46:00.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6332024-12-06T02:46:00.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6342024-12-06T02:46:00.152ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 50.085971ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
6352024-12-06T02:46:00.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6362024-12-06T02:46:00.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6372024-12-06T02:46:00.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.976243ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6382024-12-06T02:46:00.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6392024-12-06T02:46:00.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6402024-12-06T02:46:00.185ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5908, tv_nsec: 552277119 } })
6412024-12-06T02:46:00.185ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
6422024-12-06T02:46:00.195ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6432024-12-06T02:46:00.195ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6442024-12-06T02:46:00.196ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6452024-12-06T02:46:00.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6462024-12-06T02:46:00.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6472024-12-06T02:46:00.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6482024-12-06T02:46:00.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6492024-12-06T02:46:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6502024-12-06T02:46:00.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6512024-12-06T02:46:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6522024-12-06T02:46:00.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532024-12-06T02:46:00.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 120.921114ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
6542024-12-06T02:46:00.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 123.075125ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6552024-12-06T02:46:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6562024-12-06T02:46:00.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6572024-12-06T02:46:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6582024-12-06T02:46:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6592024-12-06T02:46:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6602024-12-06T02:46:00.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6612024-12-06T02:46:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6622024-12-06T02:46:00.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6632024-12-06T02:46:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6642024-12-06T02:46:00.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6652024-12-06T02:46:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6662024-12-06T02:46:00.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6672024-12-06T02:46:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6682024-12-06T02:46:00.260ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6692024-12-06T02:46:00.260ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6702024-12-06T02:46:00.260ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 157.52763ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6712024-12-06T02:46:00.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6722024-12-06T02:46:00.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732024-12-06T02:46:00.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6742024-12-06T02:46:00.262ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6752024-12-06T02:46:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6762024-12-06T02:46:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6772024-12-06T02:46:00.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6782024-12-06T02:46:00.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6792024-12-06T02:46:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6802024-12-06T02:46:00.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6812024-12-06T02:46:00.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 164.140489ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
6822024-12-06T02:46:00.268ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6832024-12-06T02:46:00.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-12-06T02:46:00.268ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6852024-12-06T02:46:00.268ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 166.150416ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6862024-12-06T02:46:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
6872024-12-06T02:46:00.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6882024-12-06T02:46:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6892024-12-06T02:46:00.275ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6902024-12-06T02:46:00.276ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6912024-12-06T02:46:00.276ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6922024-12-06T02:46:00.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6932024-12-06T02:46:00.280ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6942024-12-06T02:46:00.280ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6952024-12-06T02:46:00.280ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 177.84244ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6962024-12-06T02:46:00.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6972024-12-06T02:46:00.290ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
6982024-12-06T02:46:00.290ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 188.212896ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
6992024-12-06T02:46:00.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7002024-12-06T02:46:00.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7012024-12-06T02:46:00.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7022024-12-06T02:46:00.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7032024-12-06T02:46:00.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7042024-12-06T02:46:00.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7052024-12-06T02:46:00.297ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7062024-12-06T02:46:00.297ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7072024-12-06T02:46:00.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
7082024-12-06T02:46:00.298ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7092024-12-06T02:46:00.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7102024-12-06T02:46:00.300ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cbdaffe-f30f-414b-badf-5c85ab8c32fc", "content-length": "26", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
7112024-12-06T02:46:00.300ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7122024-12-06T02:46:00.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7132024-12-06T02:46:00.303ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 201.557237ms iteration = 9 status = 0
7142024-12-06T02:46:00.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7152024-12-06T02:46:00.307ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7162024-12-06T02:46:00.307ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7172024-12-06T02:46:00.308ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0338f59f-5840-474a-95de-f94b9afc1246", "content-length": "26", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
7182024-12-06T02:46:00.308ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7192024-12-06T02:46:00.310ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7202024-12-06T02:46:00.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212024-12-06T02:46:00.318ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7222024-12-06T02:46:00.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7232024-12-06T02:46:00.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7242024-12-06T02:46:00.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7252024-12-06T02:46:00.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7262024-12-06T02:46:00.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7272024-12-06T02:46:00.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7282024-12-06T02:46:00.328ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7292024-12-06T02:46:00.328ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7302024-12-06T02:46:00.328ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7312024-12-06T02:46:00.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7322024-12-06T02:46:00.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7332024-12-06T02:46:00.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7342024-12-06T02:46:00.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7352024-12-06T02:46:00.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7362024-12-06T02:46:00.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7372024-12-06T02:46:00.335ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7382024-12-06T02:46:00.335ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7392024-12-06T02:46:00.335ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 232.84558ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7402024-12-06T02:46:00.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7412024-12-06T02:46:00.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7422024-12-06T02:46:00.339ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432024-12-06T02:46:00.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7442024-12-06T02:46:00.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7452024-12-06T02:46:00.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7462024-12-06T02:46:00.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 239.322606ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7472024-12-06T02:46:00.342ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
7482024-12-06T02:46:00.342ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7492024-12-06T02:46:00.343ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87d9ae6b-da9d-4f0e-bf82-8dc3354843bb", "content-length": "26", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
7502024-12-06T02:46:00.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7512024-12-06T02:46:00.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
7522024-12-06T02:46:00.348ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7532024-12-06T02:46:00.348ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7542024-12-06T02:46:00.348ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7552024-12-06T02:46:00.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7562024-12-06T02:46:00.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7572024-12-06T02:46:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582024-12-06T02:46:00.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7592024-12-06T02:46:00.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7602024-12-06T02:46:00.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7612024-12-06T02:46:00.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 270.903288ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7622024-12-06T02:46:00.383ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7632024-12-06T02:46:00.383ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
7642024-12-06T02:46:00.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7652024-12-06T02:46:00.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7662024-12-06T02:46:00.384ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
7672024-12-06T02:46:00.384ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 282.16529ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7682024-12-06T02:46:00.403ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7692024-12-06T02:46:00.403ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7702024-12-06T02:46:00.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7712024-12-06T02:46:00.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7722024-12-06T02:46:00.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732024-12-06T02:46:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7742024-12-06T02:46:00.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7752024-12-06T02:46:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7762024-12-06T02:46:00.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772024-12-06T02:46:00.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7782024-12-06T02:46:00.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7792024-12-06T02:46:00.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7802024-12-06T02:46:00.441ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7812024-12-06T02:46:00.441ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 339.000013ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7822024-12-06T02:46:00.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7832024-12-06T02:46:00.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7842024-12-06T02:46:00.447ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7852024-12-06T02:46:00.448ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a29c61a8-8e4c-45d1-91c5-275d844af7b9", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7862024-12-06T02:46:00.448ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7872024-12-06T02:46:00.450ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2a14a5ff-eb73-47c2-b320-934ae65110c2", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7882024-12-06T02:46:00.450ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7892024-12-06T02:46:00.451ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7902024-12-06T02:46:00.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 349.192004ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7912024-12-06T02:46:00.452ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 350.458771ms iteration = 12 status = {"physical_disks_added":0}
7922024-12-06T02:46:00.486ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7932024-12-06T02:46:00.486ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8c1b0ef-7ff0-47c9-874e-7def232464f2", "content-length": "1", "date": "Fri, 06 Dec 2024 02:45:59 GMT"} })
7942024-12-06T02:46:00.489ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7952024-12-06T02:46:00.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7962024-12-06T02:46:00.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2c4f9572-1a1f-4aaa-92ea-95654226075b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
7972024-12-06T02:46:00.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2c4f9572-1a1f-4aaa-92ea-95654226075b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
7982024-12-06T02:46:00.541ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7992024-12-06T02:46:00.541ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8002024-12-06T02:46:00.541ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "87d6aeee-321c-48cf-8b53-11478358fdac", "content-length": "372", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8012024-12-06T02:46:00.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8022024-12-06T02:46:00.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8032024-12-06T02:46:00.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8042024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
8052024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8062024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
8072024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 441.725507ms iteration = 6 status = {"generation":2}
8082024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
8092024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8102024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
8112024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 442.387866ms iteration = 6 status = {"generation":1}
8122024-12-06T02:46:00.544ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 442.600212ms iteration = 9 status = null
8132024-12-06T02:46:00.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2c4f9572-1a1f-4aaa-92ea-95654226075b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8142024-12-06T02:46:00.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8152024-12-06T02:46:00.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8162024-12-06T02:46:00.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8172024-12-06T02:46:00.585ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8182024-12-06T02:46:00.585ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8192024-12-06T02:46:00.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8202024-12-06T02:46:00.585ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4f053ae4-f9d1-44d9-889d-0d1eca80bc0e", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8212024-12-06T02:46:00.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8222024-12-06T02:46:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8232024-12-06T02:46:00.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8242024-12-06T02:46:00.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8252024-12-06T02:46:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8262024-12-06T02:46:00.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8272024-12-06T02:46:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8282024-12-06T02:46:00.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8292024-12-06T02:46:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8302024-12-06T02:46:00.597ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8312024-12-06T02:46:00.597ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8322024-12-06T02:46:00.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "adab6004-4dbc-4ce1-ad58-7485e83bb812", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8332024-12-06T02:46:00.599ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 497.715196ms iteration = 10 status = {}
8342024-12-06T02:46:00.634ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 532.248773ms iteration = 9 status = {}
8352024-12-06T02:46:00.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8362024-12-06T02:46:00.767ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8372024-12-06T02:46:00.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
8382024-12-06T02:46:00.817ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e8531e51-48f7-402b-8806-d9925004d081", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8392024-12-06T02:46:00.817ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8402024-12-06T02:46:00.818ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e92d1a33-b4f9-496a-b8a3-9c84722cb65c", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8412024-12-06T02:46:00.818ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8422024-12-06T02:46:00.820ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5e42ea59-f0dc-436a-bee1-f56ad66cf3d1", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8432024-12-06T02:46:00.820ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8442024-12-06T02:46:00.821ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8452024-12-06T02:46:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 719.697537ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8462024-12-06T02:46:00.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8472024-12-06T02:46:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8482024-12-06T02:46:00.849ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
8492024-12-06T02:46:00.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8502024-12-06T02:46:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8512024-12-06T02:46:00.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8522024-12-06T02:46:00.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac658676-0d7a-4756-a574-851a8bd84e98", "content-length": "134", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8532024-12-06T02:46:00.859ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8542024-12-06T02:46:00.859ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
8552024-12-06T02:46:00.859ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8562024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8572024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8582024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8592024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8602024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8612024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8622024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8632024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
8642024-12-06T02:46:00.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8652024-12-06T02:46:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8662024-12-06T02:46:00.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aa5cd8c-eaae-47e9-9040-660c65c94b3a", "content-length": "691", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8672024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8682024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8692024-12-06T02:46:00.860ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8702024-12-06T02:46:00.862ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 760.540264ms iteration = 9 status = {}
8712024-12-06T02:46:00.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8722024-12-06T02:46:00.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "07788f0f-d3fd-4526-9df4-46627e50395f", "content-length": "2", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8732024-12-06T02:46:00.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8742024-12-06T02:46:00.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb2889bb-d3b4-4170-afda-ad5f67592c44", "content-length": "52", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8752024-12-06T02:46:00.863ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
8762024-12-06T02:46:00.863ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8772024-12-06T02:46:01.035ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a2bcf75c-b939-4895-b61d-f186cb694a0b", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8782024-12-06T02:46:01.035ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
8792024-12-06T02:46:01.035ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8802024-12-06T02:46:01.035ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "43ff2a6e-2d12-4ef8-9f9b-67e146cd5544", "content-length": "682", "date": "Fri, 06 Dec 2024 02:46:00 GMT"} })
8812024-12-06T02:46:01.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8822024-12-06T02:46:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8832024-12-06T02:46:01.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8842024-12-06T02:46:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8852024-12-06T02:46:01.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8862024-12-06T02:46:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8872024-12-06T02:46:01.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8882024-12-06T02:46:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8892024-12-06T02:46:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 950.096548ms iteration = 9 status = {}
8902024-12-06T02:46:01.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = df82de35-e5a4-44d8-9ff8-d1189e522f1f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8912024-12-06T02:46:01.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = df82de35-e5a4-44d8-9ff8-d1189e522f1f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8922024-12-06T02:46:01.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = df82de35-e5a4-44d8-9ff8-d1189e522f1f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8932024-12-06T02:46:01.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8a2d11b7-86d5-47d4-b22e-60e257c047be roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8942024-12-06T02:46:01.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8a2d11b7-86d5-47d4-b22e-60e257c047be resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8952024-12-06T02:46:01.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8a2d11b7-86d5-47d4-b22e-60e257c047be response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8962024-12-06T02:46:02.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ee3d43f6-d6d5-48dc-8a6f-4c07169cb7b4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8972024-12-06T02:46:02.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ee3d43f6-d6d5-48dc-8a6f-4c07169cb7b4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8982024-12-06T02:46:02.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ee3d43f6-d6d5-48dc-8a6f-4c07169cb7b4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
8992024-12-06T02:46:03.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9fdd2f22-7eae-418a-b431-156327045162 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9002024-12-06T02:46:03.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9fdd2f22-7eae-418a-b431-156327045162 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9012024-12-06T02:46:03.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9fdd2f22-7eae-418a-b431-156327045162 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9022024-12-06T02:46:04.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 489047ec-4615-4530-a591-8abcf118c473 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9032024-12-06T02:46:04.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 489047ec-4615-4530-a591-8abcf118c473 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9042024-12-06T02:46:04.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 489047ec-4615-4530-a591-8abcf118c473 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9052024-12-06T02:46:05.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1207 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 40096606-6d2e-4e37-8734-b020f3511275 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
9062024-12-06T02:46:05.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a043663b-9b2d-4adb-a444-21a14b710957 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9072024-12-06T02:46:05.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a043663b-9b2d-4adb-a444-21a14b710957 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9082024-12-06T02:46:05.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a043663b-9b2d-4adb-a444-21a14b710957 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9092024-12-06T02:46:06.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a627c723-20f9-4fb2-9830-1c803f204239 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9102024-12-06T02:46:06.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a627c723-20f9-4fb2-9830-1c803f204239 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9112024-12-06T02:46:06.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a627c723-20f9-4fb2-9830-1c803f204239 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9122024-12-06T02:46:07.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc4cfdda-4744-41f5-a77c-6c66121d2e7d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9132024-12-06T02:46:07.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc4cfdda-4744-41f5-a77c-6c66121d2e7d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9142024-12-06T02:46:07.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc4cfdda-4744-41f5-a77c-6c66121d2e7d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9152024-12-06T02:46:08.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f6b70f53-fa57-40b1-a1df-8687ea18d4a7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9162024-12-06T02:46:08.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f6b70f53-fa57-40b1-a1df-8687ea18d4a7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9172024-12-06T02:46:08.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f6b70f53-fa57-40b1-a1df-8687ea18d4a7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9182024-12-06T02:46:09.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b7c99daf-8ed8-40ec-8653-6884d1e28491 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9192024-12-06T02:46:09.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b7c99daf-8ed8-40ec-8653-6884d1e28491 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9202024-12-06T02:46:09.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b7c99daf-8ed8-40ec-8653-6884d1e28491 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9212024-12-06T02:46:10.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
9222024-12-06T02:46:10.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9232024-12-06T02:46:10.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
9242024-12-06T02:46:10.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9252024-12-06T02:46:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9262024-12-06T02:46:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9272024-12-06T02:46:10.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9282024-12-06T02:46:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9292024-12-06T02:46:10.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9302024-12-06T02:46:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9312024-12-06T02:46:10.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9322024-12-06T02:46:10.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9332024-12-06T02:46:10.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9342024-12-06T02:46:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
9352024-12-06T02:46:10.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9362024-12-06T02:46:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9372024-12-06T02:46:10.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
9382024-12-06T02:46:10.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.834033ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
9392024-12-06T02:46:10.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9402024-12-06T02:46:10.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9412024-12-06T02:46:10.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.969611ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9422024-12-06T02:46:10.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5ce1699f-cce8-4b86-9c48-037760635154 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9432024-12-06T02:46:10.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5ce1699f-cce8-4b86-9c48-037760635154 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9442024-12-06T02:46:10.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5ce1699f-cce8-4b86-9c48-037760635154 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9452024-12-06T02:46:11.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6486dc59-9395-4ee3-a05d-7db9eb1c28d2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9462024-12-06T02:46:11.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6486dc59-9395-4ee3-a05d-7db9eb1c28d2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9472024-12-06T02:46:11.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6486dc59-9395-4ee3-a05d-7db9eb1c28d2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9482024-12-06T02:46:12.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 162df1cc-1a61-4a27-81c9-666e4e14c830 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9492024-12-06T02:46:12.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 162df1cc-1a61-4a27-81c9-666e4e14c830 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9502024-12-06T02:46:12.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 162df1cc-1a61-4a27-81c9-666e4e14c830 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9512024-12-06T02:46:13.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d6715fd-305d-42aa-9495-aa70a2201b2e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9522024-12-06T02:46:13.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d6715fd-305d-42aa-9495-aa70a2201b2e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9532024-12-06T02:46:13.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d6715fd-305d-42aa-9495-aa70a2201b2e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9542024-12-06T02:46:14.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8776da4b-77eb-4e0c-a5ff-7fb64027f78a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9552024-12-06T02:46:14.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8776da4b-77eb-4e0c-a5ff-7fb64027f78a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9562024-12-06T02:46:14.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8776da4b-77eb-4e0c-a5ff-7fb64027f78a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9572024-12-06T02:46:15.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 6c6190cd-d767-4160-b454-1d56e7f18d50 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
9582024-12-06T02:46:15.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 6c6190cd-d767-4160-b454-1d56e7f18d50 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
9592024-12-06T02:46:15.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 6c6190cd-d767-4160-b454-1d56e7f18d50 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
9602024-12-06T02:46:15.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = e5d484b2-daef-494d-bb10-849173c38a02 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
9612024-12-06T02:46:15.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = e5d484b2-daef-494d-bb10-849173c38a02 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
9622024-12-06T02:46:15.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = e5d484b2-daef-494d-bb10-849173c38a02 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
9632024-12-06T02:46:15.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1158 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 88e8963e-d3fe-4b5d-bc15-cbb32478aa8d response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
9642024-12-06T02:46:15.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 970b3375-a4eb-4776-a7b7-0addb947f148 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9652024-12-06T02:46:15.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 970b3375-a4eb-4776-a7b7-0addb947f148 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9662024-12-06T02:46:15.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 970b3375-a4eb-4776-a7b7-0addb947f148 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9672024-12-06T02:46:16.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 956b1608-5ca6-4638-8f02-1e763e9a37c3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9682024-12-06T02:46:16.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 956b1608-5ca6-4638-8f02-1e763e9a37c3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9692024-12-06T02:46:16.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 956b1608-5ca6-4638-8f02-1e763e9a37c3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9702024-12-06T02:46:17.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8cd3101-15a7-4fb0-b808-2e5b524ac5fb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9712024-12-06T02:46:17.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8cd3101-15a7-4fb0-b808-2e5b524ac5fb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9722024-12-06T02:46:17.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8cd3101-15a7-4fb0-b808-2e5b524ac5fb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9732024-12-06T02:46:18.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 539cfe4a-1d9c-4201-912f-cc6fa84d919d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9742024-12-06T02:46:18.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 539cfe4a-1d9c-4201-912f-cc6fa84d919d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9752024-12-06T02:46:18.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 539cfe4a-1d9c-4201-912f-cc6fa84d919d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9762024-12-06T02:46:19.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a4fb6a26-682a-470a-8116-abeb584c81a1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9772024-12-06T02:46:19.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a4fb6a26-682a-470a-8116-abeb584c81a1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9782024-12-06T02:46:19.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a4fb6a26-682a-470a-8116-abeb584c81a1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
9792024-12-06T02:46:20.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
9802024-12-06T02:46:20.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9812024-12-06T02:46:20.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
9822024-12-06T02:46:20.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9832024-12-06T02:46:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9842024-12-06T02:46:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9852024-12-06T02:46:20.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862024-12-06T02:46:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9872024-12-06T02:46:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9882024-12-06T02:46:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9892024-12-06T02:46:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9902024-12-06T02:46:20.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9912024-12-06T02:46:20.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9922024-12-06T02:46:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
9932024-12-06T02:46:20.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9942024-12-06T02:46:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9952024-12-06T02:46:20.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
9962024-12-06T02:46:20.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.241406ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
9972024-12-06T02:46:20.131ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9982024-12-06T02:46:20.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9992024-12-06T02:46:20.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.344366ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10002024-12-06T02:46:20.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d405431-52f4-46ee-9c5b-7f53bbe98518 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10012024-12-06T02:46:20.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d405431-52f4-46ee-9c5b-7f53bbe98518 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10022024-12-06T02:46:20.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d405431-52f4-46ee-9c5b-7f53bbe98518 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10032024-12-06T02:46:21.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = abdfa09d-2012-41ca-9068-fd742ac640f1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10042024-12-06T02:46:21.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = abdfa09d-2012-41ca-9068-fd742ac640f1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10052024-12-06T02:46:21.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = abdfa09d-2012-41ca-9068-fd742ac640f1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10062024-12-06T02:46:23.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a85b1f59-1fe2-43aa-ab5a-88aa5ee9bbd3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10072024-12-06T02:46:23.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a85b1f59-1fe2-43aa-ab5a-88aa5ee9bbd3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10082024-12-06T02:46:23.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a85b1f59-1fe2-43aa-ab5a-88aa5ee9bbd3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10092024-12-06T02:46:24.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f819d753-ab4a-495f-b1cb-8910ec5442dd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10102024-12-06T02:46:24.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f819d753-ab4a-495f-b1cb-8910ec5442dd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10112024-12-06T02:46:24.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f819d753-ab4a-495f-b1cb-8910ec5442dd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10122024-12-06T02:46:25.027ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1312 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 0d15f9c6-422e-41ba-b02d-49d0f29453bc response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
10132024-12-06T02:46:25.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3437deb7-8d71-41a4-a0e3-ab0d0f5a3118 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10142024-12-06T02:46:25.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3437deb7-8d71-41a4-a0e3-ab0d0f5a3118 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10152024-12-06T02:46:25.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3437deb7-8d71-41a4-a0e3-ab0d0f5a3118 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10162024-12-06T02:46:26.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b57bedab-061d-454c-9914-de332c089024 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10172024-12-06T02:46:26.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b57bedab-061d-454c-9914-de332c089024 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10182024-12-06T02:46:26.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b57bedab-061d-454c-9914-de332c089024 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10192024-12-06T02:46:27.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb8c4b1a-6e36-49ac-879c-032847bc0aaa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10202024-12-06T02:46:27.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb8c4b1a-6e36-49ac-879c-032847bc0aaa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10212024-12-06T02:46:27.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb8c4b1a-6e36-49ac-879c-032847bc0aaa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10222024-12-06T02:46:28.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 901162d6-f2da-45a7-a3e9-39926a665462 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10232024-12-06T02:46:28.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 901162d6-f2da-45a7-a3e9-39926a665462 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10242024-12-06T02:46:28.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 901162d6-f2da-45a7-a3e9-39926a665462 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10252024-12-06T02:46:29.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 33901c2c-b304-4878-aa87-16746cde4ee7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10262024-12-06T02:46:29.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 33901c2c-b304-4878-aa87-16746cde4ee7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10272024-12-06T02:46:29.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 33901c2c-b304-4878-aa87-16746cde4ee7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
10282024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
10292024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10302024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
10312024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10322024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
10332024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
10342024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10352024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
10362024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10372024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10382024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
10392024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
10402024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
10412024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10422024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10432024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10442024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
10452024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
10462024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10472024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10482024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
10492024-12-06T02:46:30.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10502024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10512024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
10522024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10532024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
10542024-12-06T02:46:30.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10552024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10562024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10572024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10582024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10592024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10602024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10612024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10622024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10632024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10642024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10652024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10662024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10672024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
10682024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
10692024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
10702024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10712024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
10722024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10732024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10742024-12-06T02:46:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10752024-12-06T02:46:30.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10762024-12-06T02:46:30.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10772024-12-06T02:46:30.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10782024-12-06T02:46:30.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10792024-12-06T02:46:30.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802024-12-06T02:46:30.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10812024-12-06T02:46:30.105ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.797568ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10822024-12-06T02:46:30.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10832024-12-06T02:46:30.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10842024-12-06T02:46:30.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10852024-12-06T02:46:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10862024-12-06T02:46:30.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10872024-12-06T02:46:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10882024-12-06T02:46:30.112ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5938, tv_nsec: 478566442 } })
10892024-12-06T02:46:30.112ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10902024-12-06T02:46:30.112ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10912024-12-06T02:46:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10922024-12-06T02:46:30.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932024-12-06T02:46:30.114ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10942024-12-06T02:46:30.114ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10952024-12-06T02:46:30.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10962024-12-06T02:46:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10972024-12-06T02:46:30.115ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5938, tv_nsec: 482284409 } })
10982024-12-06T02:46:30.115ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10992024-12-06T02:46:30.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11002024-12-06T02:46:30.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11012024-12-06T02:46:30.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11022024-12-06T02:46:30.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032024-12-06T02:46:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11042024-12-06T02:46:30.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11052024-12-06T02:46:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11062024-12-06T02:46:30.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11072024-12-06T02:46:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11082024-12-06T02:46:30.126ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5938, tv_nsec: 493678163 } })
11092024-12-06T02:46:30.127ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
11102024-12-06T02:46:30.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.208664ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11112024-12-06T02:46:30.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11122024-12-06T02:46:30.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11132024-12-06T02:46:30.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.295785ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
11142024-12-06T02:46:30.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3c5660af-c807-4c86-a6ba-c950108e3a45 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
11152024-12-06T02:46:30.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3c5660af-c807-4c86-a6ba-c950108e3a45 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
11162024-12-06T02:46:30.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3c5660af-c807-4c86-a6ba-c950108e3a45 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
11172024-12-06T02:46:30.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182024-12-06T02:46:30.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11192024-12-06T02:46:30.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11202024-12-06T02:46:30.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11212024-12-06T02:46:30.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11222024-12-06T02:46:30.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11232024-12-06T02:46:30.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-12-06T02:46:30.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11252024-12-06T02:46:30.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11262024-12-06T02:46:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11272024-12-06T02:46:30.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11282024-12-06T02:46:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11292024-12-06T02:46:30.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.692319ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
11302024-12-06T02:46:30.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11312024-12-06T02:46:30.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11322024-12-06T02:46:30.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11332024-12-06T02:46:30.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11342024-12-06T02:46:30.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352024-12-06T02:46:30.187ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11362024-12-06T02:46:30.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11372024-12-06T02:46:30.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11382024-12-06T02:46:30.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11392024-12-06T02:46:30.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11402024-12-06T02:46:30.195ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11412024-12-06T02:46:30.195ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11422024-12-06T02:46:30.195ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11432024-12-06T02:46:30.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11442024-12-06T02:46:30.197ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11452024-12-06T02:46:30.197ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.210707ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11462024-12-06T02:46:30.212ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11472024-12-06T02:46:30.212ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11482024-12-06T02:46:30.212ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e785b341-ebb8-46f9-986a-81919b8ec8ed", "content-length": "26", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
11492024-12-06T02:46:30.212ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11502024-12-06T02:46:30.214ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11512024-12-06T02:46:30.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11522024-12-06T02:46:30.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
11532024-12-06T02:46:30.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11542024-12-06T02:46:30.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11552024-12-06T02:46:30.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11562024-12-06T02:46:30.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11572024-12-06T02:46:30.224ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11582024-12-06T02:46:30.224ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11592024-12-06T02:46:30.224ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "969aef8f-a28e-48cb-8e55-7c075efb8cd3", "content-length": "26", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
11602024-12-06T02:46:30.224ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11612024-12-06T02:46:30.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.148123ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11622024-12-06T02:46:30.226ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11632024-12-06T02:46:30.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.589818ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11642024-12-06T02:46:30.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-12-06T02:46:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11662024-12-06T02:46:30.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11672024-12-06T02:46:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11682024-12-06T02:46:30.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.442581ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11692024-12-06T02:46:30.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
11702024-12-06T02:46:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 138.000511ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
11712024-12-06T02:46:30.251ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11722024-12-06T02:46:30.251ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11732024-12-06T02:46:30.251ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.281462ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11742024-12-06T02:46:30.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
11752024-12-06T02:46:30.256ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11762024-12-06T02:46:30.257ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "addcb899-b214-457d-980a-8fd9e2bc6552", "content-length": "26", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
11772024-12-06T02:46:30.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11782024-12-06T02:46:30.258ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
11792024-12-06T02:46:30.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11802024-12-06T02:46:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11812024-12-06T02:46:30.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11822024-12-06T02:46:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11832024-12-06T02:46:30.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11842024-12-06T02:46:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
11852024-12-06T02:46:30.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11862024-12-06T02:46:30.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11872024-12-06T02:46:30.274ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 172.712782ms iteration = 10 status = 0
11882024-12-06T02:46:30.282ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.148373ms iteration = 13 status = {"physical_disks_added":0}
11892024-12-06T02:46:30.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11902024-12-06T02:46:30.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11912024-12-06T02:46:30.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922024-12-06T02:46:30.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11932024-12-06T02:46:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11942024-12-06T02:46:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11952024-12-06T02:46:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11962024-12-06T02:46:30.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11972024-12-06T02:46:30.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11982024-12-06T02:46:30.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11992024-12-06T02:46:30.406ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12002024-12-06T02:46:30.406ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12012024-12-06T02:46:30.407ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce4359a3-b272-4457-9df6-2ea97e8ae936", "content-length": "372", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12022024-12-06T02:46:30.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12032024-12-06T02:46:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12042024-12-06T02:46:30.409ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.413559ms iteration = 10 status = {}
12052024-12-06T02:46:30.425ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12062024-12-06T02:46:30.425ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "045b1c03-59d1-4a40-8ab7-02d02417e3c4", "content-length": "1", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12072024-12-06T02:46:30.427ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12082024-12-06T02:46:30.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12092024-12-06T02:46:30.429ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 327.975038ms iteration = 10 status = null
12102024-12-06T02:46:30.448ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12112024-12-06T02:46:30.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12122024-12-06T02:46:30.448ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "965a2385-49be-4252-a2e5-c629b141b67e", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12132024-12-06T02:46:30.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12142024-12-06T02:46:30.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12152024-12-06T02:46:30.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12162024-12-06T02:46:30.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12172024-12-06T02:46:30.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12182024-12-06T02:46:30.474ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7b7a136-a4c2-471a-8255-bf0a706bb2b5", "content-length": "691", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12192024-12-06T02:46:30.474ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12202024-12-06T02:46:30.474ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12212024-12-06T02:46:30.474ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12222024-12-06T02:46:30.475ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 374.066914ms iteration = 10 status = {}
12232024-12-06T02:46:30.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12242024-12-06T02:46:30.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12252024-12-06T02:46:30.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12262024-12-06T02:46:30.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12272024-12-06T02:46:30.503ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
12282024-12-06T02:46:30.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12292024-12-06T02:46:30.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12302024-12-06T02:46:30.514ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12312024-12-06T02:46:30.514ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d901764-1330-48bf-9662-e3e62ca52f59", "content-length": "134", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12322024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12332024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
12342024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12352024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12362024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12372024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12382024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12392024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12402024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12412024-12-06T02:46:30.514ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12422024-12-06T02:46:30.515ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
12432024-12-06T02:46:30.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12442024-12-06T02:46:30.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12452024-12-06T02:46:30.517ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12462024-12-06T02:46:30.517ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f56e84b-0e2b-42da-a2bc-ed50da19389a", "content-length": "2", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12472024-12-06T02:46:30.517ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12482024-12-06T02:46:30.517ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "680c783e-7eb0-4e16-866e-90987e649334", "content-length": "52", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12492024-12-06T02:46:30.517ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
12502024-12-06T02:46:30.517ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12512024-12-06T02:46:30.583ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12522024-12-06T02:46:30.583ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12532024-12-06T02:46:30.584ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "636c4d17-682a-43c5-93b9-c0407b9422b9", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12542024-12-06T02:46:30.586ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 484.401905ms iteration = 11 status = {}
12552024-12-06T02:46:30.756ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3a10d7dc-99ce-4f2d-87d3-75f966e7274a", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12562024-12-06T02:46:30.756ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
12572024-12-06T02:46:30.756ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12582024-12-06T02:46:30.757ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "22d5e6b5-ed87-42b0-b65c-7c67f31b2808", "content-length": "682", "date": "Fri, 06 Dec 2024 02:46:30 GMT"} })
12592024-12-06T02:46:30.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12602024-12-06T02:46:30.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12612024-12-06T02:46:30.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12622024-12-06T02:46:30.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12632024-12-06T02:46:30.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12642024-12-06T02:46:30.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12652024-12-06T02:46:30.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12662024-12-06T02:46:30.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12672024-12-06T02:46:30.773ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 672.269052ms iteration = 10 status = {}
12682024-12-06T02:46:31.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 96946382-25a5-4862-89c4-59b5b765182b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12692024-12-06T02:46:31.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 96946382-25a5-4862-89c4-59b5b765182b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12702024-12-06T02:46:31.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 96946382-25a5-4862-89c4-59b5b765182b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12712024-12-06T02:46:31.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 8b9e0cf4-a98f-4d4a-80cd-9113d5266eb7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12722024-12-06T02:46:31.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 8b9e0cf4-a98f-4d4a-80cd-9113d5266eb7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12732024-12-06T02:46:31.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 8b9e0cf4-a98f-4d4a-80cd-9113d5266eb7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12742024-12-06T02:46:32.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b18d7af4-80e4-4877-aff6-b3d8d1cea348 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12752024-12-06T02:46:32.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b18d7af4-80e4-4877-aff6-b3d8d1cea348 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12762024-12-06T02:46:32.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b18d7af4-80e4-4877-aff6-b3d8d1cea348 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12772024-12-06T02:46:33.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e311918b-0a30-4fdd-b53d-996ca4f986b2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12782024-12-06T02:46:33.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e311918b-0a30-4fdd-b53d-996ca4f986b2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12792024-12-06T02:46:33.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e311918b-0a30-4fdd-b53d-996ca4f986b2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12802024-12-06T02:46:34.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 04efa00f-c08d-4cef-a8fd-e5a7804706c9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12812024-12-06T02:46:34.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 04efa00f-c08d-4cef-a8fd-e5a7804706c9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12822024-12-06T02:46:34.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 04efa00f-c08d-4cef-a8fd-e5a7804706c9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12832024-12-06T02:46:35.027ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1231 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 6ecd47f3-acee-4a44-9d49-6fa768611af6 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
12842024-12-06T02:46:35.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c918e91c-6e39-4f43-b4d5-b66382aa560f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12852024-12-06T02:46:35.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c918e91c-6e39-4f43-b4d5-b66382aa560f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12862024-12-06T02:46:35.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c918e91c-6e39-4f43-b4d5-b66382aa560f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12872024-12-06T02:46:36.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 88f7ed25-f9d0-434c-a497-fc79c3d2c006 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12882024-12-06T02:46:36.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 88f7ed25-f9d0-434c-a497-fc79c3d2c006 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12892024-12-06T02:46:36.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 88f7ed25-f9d0-434c-a497-fc79c3d2c006 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12902024-12-06T02:46:37.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4018fed9-555f-4e19-af1f-fdb56ffdc790 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12912024-12-06T02:46:37.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4018fed9-555f-4e19-af1f-fdb56ffdc790 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12922024-12-06T02:46:37.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4018fed9-555f-4e19-af1f-fdb56ffdc790 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12932024-12-06T02:46:38.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28aa6f12-5a7d-496e-ba3a-9596103bd6f4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12942024-12-06T02:46:38.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28aa6f12-5a7d-496e-ba3a-9596103bd6f4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12952024-12-06T02:46:38.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28aa6f12-5a7d-496e-ba3a-9596103bd6f4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12962024-12-06T02:46:39.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 987c83ae-55ae-4864-8137-a98972e4b928 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12972024-12-06T02:46:39.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 987c83ae-55ae-4864-8137-a98972e4b928 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12982024-12-06T02:46:39.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 987c83ae-55ae-4864-8137-a98972e4b928 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
12992024-12-06T02:46:40.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
13002024-12-06T02:46:40.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
13012024-12-06T02:46:40.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13022024-12-06T02:46:40.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13032024-12-06T02:46:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13042024-12-06T02:46:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13052024-12-06T02:46:40.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13062024-12-06T02:46:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13072024-12-06T02:46:40.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13082024-12-06T02:46:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13092024-12-06T02:46:40.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13102024-12-06T02:46:40.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13112024-12-06T02:46:40.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122024-12-06T02:46:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
13132024-12-06T02:46:40.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13142024-12-06T02:46:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13152024-12-06T02:46:40.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
13162024-12-06T02:46:40.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.784405ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
13172024-12-06T02:46:40.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13182024-12-06T02:46:40.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13192024-12-06T02:46:40.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.583667ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13202024-12-06T02:46:40.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8d7141a9-571e-4c9a-aba6-d0d517cb6ddf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13212024-12-06T02:46:40.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8d7141a9-571e-4c9a-aba6-d0d517cb6ddf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13222024-12-06T02:46:40.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8d7141a9-571e-4c9a-aba6-d0d517cb6ddf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13232024-12-06T02:46:41.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90bd594e-65bf-4a95-aeb7-31e599199c6d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13242024-12-06T02:46:41.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90bd594e-65bf-4a95-aeb7-31e599199c6d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13252024-12-06T02:46:41.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90bd594e-65bf-4a95-aeb7-31e599199c6d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13262024-12-06T02:46:42.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7146a0ad-2baa-4516-8e9f-0a526d0cd1f9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13272024-12-06T02:46:42.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7146a0ad-2baa-4516-8e9f-0a526d0cd1f9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13282024-12-06T02:46:42.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7146a0ad-2baa-4516-8e9f-0a526d0cd1f9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13292024-12-06T02:46:43.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 931a826a-6db4-4a26-be6d-9e0bfbd2d97f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13302024-12-06T02:46:43.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 931a826a-6db4-4a26-be6d-9e0bfbd2d97f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13312024-12-06T02:46:43.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 931a826a-6db4-4a26-be6d-9e0bfbd2d97f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13322024-12-06T02:46:44.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7232c55-995c-4851-ae33-0398d8a666dc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13332024-12-06T02:46:44.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7232c55-995c-4851-ae33-0398d8a666dc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13342024-12-06T02:46:44.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7232c55-995c-4851-ae33-0398d8a666dc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13352024-12-06T02:46:45.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 2c77b614-b367-440f-95d4-6b9a0d581cd5 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
13362024-12-06T02:46:45.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 2c77b614-b367-440f-95d4-6b9a0d581cd5 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
13372024-12-06T02:46:45.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 2c77b614-b367-440f-95d4-6b9a0d581cd5 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
13382024-12-06T02:46:45.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 41a13f9b-c7a5-4bca-89eb-8bb634b310bd roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
13392024-12-06T02:46:45.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 41a13f9b-c7a5-4bca-89eb-8bb634b310bd resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
13402024-12-06T02:46:45.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 41a13f9b-c7a5-4bca-89eb-8bb634b310bd response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
13412024-12-06T02:46:45.027ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1198 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = f8d4123a-078a-43a5-be2d-742f6cabe1a6 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
13422024-12-06T02:46:45.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c1e73b67-96a9-4748-8eb3-0891061b01ba roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13432024-12-06T02:46:45.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c1e73b67-96a9-4748-8eb3-0891061b01ba resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13442024-12-06T02:46:45.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c1e73b67-96a9-4748-8eb3-0891061b01ba response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13452024-12-06T02:46:46.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ad4151aa-370c-438d-b8fb-2aff0d9414aa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13462024-12-06T02:46:46.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ad4151aa-370c-438d-b8fb-2aff0d9414aa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13472024-12-06T02:46:46.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ad4151aa-370c-438d-b8fb-2aff0d9414aa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13482024-12-06T02:46:47.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6d1caad8-01f5-4a04-a22a-6b17ce596a35 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13492024-12-06T02:46:47.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6d1caad8-01f5-4a04-a22a-6b17ce596a35 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13502024-12-06T02:46:47.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6d1caad8-01f5-4a04-a22a-6b17ce596a35 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13512024-12-06T02:46:48.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b1b87d8d-3d98-4673-8d00-1e12ca62ebde roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13522024-12-06T02:46:48.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b1b87d8d-3d98-4673-8d00-1e12ca62ebde resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13532024-12-06T02:46:48.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b1b87d8d-3d98-4673-8d00-1e12ca62ebde response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13542024-12-06T02:46:49.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ec2c88fb-bba0-4fac-a40c-a044eafbd40c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13552024-12-06T02:46:49.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ec2c88fb-bba0-4fac-a40c-a044eafbd40c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13562024-12-06T02:46:49.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ec2c88fb-bba0-4fac-a40c-a044eafbd40c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13572024-12-06T02:46:50.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
13582024-12-06T02:46:50.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13592024-12-06T02:46:50.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
13602024-12-06T02:46:50.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13612024-12-06T02:46:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13622024-12-06T02:46:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13632024-12-06T02:46:50.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13642024-12-06T02:46:50.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13652024-12-06T02:46:50.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13662024-12-06T02:46:50.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13672024-12-06T02:46:50.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13682024-12-06T02:46:50.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13692024-12-06T02:46:50.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702024-12-06T02:46:50.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
13712024-12-06T02:46:50.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13722024-12-06T02:46:50.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13732024-12-06T02:46:50.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
13742024-12-06T02:46:50.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.680864ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
13752024-12-06T02:46:50.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13762024-12-06T02:46:50.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13772024-12-06T02:46:50.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.959676ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13782024-12-06T02:46:50.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e5500df9-9262-43cd-98d0-a3958325e4e2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13792024-12-06T02:46:50.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e5500df9-9262-43cd-98d0-a3958325e4e2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13802024-12-06T02:46:50.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e5500df9-9262-43cd-98d0-a3958325e4e2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13812024-12-06T02:46:51.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = affb136d-f9c8-442a-a6c1-1c089152cd41 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13822024-12-06T02:46:51.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = affb136d-f9c8-442a-a6c1-1c089152cd41 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13832024-12-06T02:46:51.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = affb136d-f9c8-442a-a6c1-1c089152cd41 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13842024-12-06T02:46:52.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41e60bb2-d6b0-4a57-b4a0-9020e77cd99d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13852024-12-06T02:46:52.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41e60bb2-d6b0-4a57-b4a0-9020e77cd99d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13862024-12-06T02:46:52.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41e60bb2-d6b0-4a57-b4a0-9020e77cd99d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13872024-12-06T02:46:53.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 344a9787-599a-4263-bcda-6c56d1e3bb12 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13882024-12-06T02:46:53.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 344a9787-599a-4263-bcda-6c56d1e3bb12 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13892024-12-06T02:46:53.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 344a9787-599a-4263-bcda-6c56d1e3bb12 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13902024-12-06T02:46:54.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0e904c4-e45f-4a58-bb09-a38acf5c46d7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13912024-12-06T02:46:54.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0e904c4-e45f-4a58-bb09-a38acf5c46d7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13922024-12-06T02:46:54.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0e904c4-e45f-4a58-bb09-a38acf5c46d7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13932024-12-06T02:46:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = d5be0b0b-e642-4b87-95ee-28505fc45866 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
13942024-12-06T02:46:55.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5270750a-9b2c-42ac-a887-b058d3c6042b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13952024-12-06T02:46:55.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5270750a-9b2c-42ac-a887-b058d3c6042b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13962024-12-06T02:46:55.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5270750a-9b2c-42ac-a887-b058d3c6042b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13972024-12-06T02:46:56.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7b56157-301b-45b5-b915-554ceabd9819 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13982024-12-06T02:46:56.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7b56157-301b-45b5-b915-554ceabd9819 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
13992024-12-06T02:46:56.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7b56157-301b-45b5-b915-554ceabd9819 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14002024-12-06T02:46:57.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 69e467a1-a9ee-47d3-ada7-cbb9d6059453 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14012024-12-06T02:46:57.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 69e467a1-a9ee-47d3-ada7-cbb9d6059453 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14022024-12-06T02:46:57.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 69e467a1-a9ee-47d3-ada7-cbb9d6059453 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14032024-12-06T02:46:58.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fd207c63-7d6f-42f5-a43a-e1c35ae444e2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14042024-12-06T02:46:58.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fd207c63-7d6f-42f5-a43a-e1c35ae444e2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14052024-12-06T02:46:58.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fd207c63-7d6f-42f5-a43a-e1c35ae444e2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14062024-12-06T02:46:59.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 86d0663b-004e-4ae9-8745-3f15eccd8fea roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14072024-12-06T02:46:59.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 86d0663b-004e-4ae9-8745-3f15eccd8fea resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14082024-12-06T02:46:59.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 86d0663b-004e-4ae9-8745-3f15eccd8fea response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
14092024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
14102024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14112024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
14122024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
14132024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
14142024-12-06T02:47:00.101ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
14152024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.761\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
14162024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
14172024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
14182024-12-06T02:47:00.101ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:37:00.101498369 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14192024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
14202024-12-06T02:47:00.101ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14212024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14222024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
14232024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14242024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14252024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
14262024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14272024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
14282024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14292024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
14302024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14312024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14322024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
14332024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
14342024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
14352024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14362024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14372024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14382024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
14392024-12-06T02:47:00.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14402024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14412024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14422024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
14432024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14442024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
14452024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14462024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
14472024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14482024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
14492024-12-06T02:47:00.101ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
14502024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14512024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
14522024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
14532024-12-06T02:47:00.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14542024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
14552024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14562024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
14572024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
14582024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14592024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
14602024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14612024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14622024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14632024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14642024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14652024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14662024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14672024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14682024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14692024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14702024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14712024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14722024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14732024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14742024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14752024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14762024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14772024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
14782024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
14792024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14802024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14812024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
14822024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14832024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
14842024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14852024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14862024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
14872024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
14882024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14892024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14902024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14912024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14922024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14932024-12-06T02:47:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5968, tv_nsec: 469372909 } })
14942024-12-06T02:47:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 5968, tv_nsec: 469364889 } })
14952024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14962024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14972024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14982024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14992024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15002024-12-06T02:47:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15012024-12-06T02:47:00.103ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15022024-12-06T02:47:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.620936ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15032024-12-06T02:47:00.103ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
15042024-12-06T02:47:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.866413ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
15052024-12-06T02:47:00.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15062024-12-06T02:47:00.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15072024-12-06T02:47:00.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15082024-12-06T02:47:00.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15092024-12-06T02:47:00.106ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5968, tv_nsec: 473802345 } })
15102024-12-06T02:47:00.107ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:37:00.101498369 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15112024-12-06T02:47:00.107ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.657002ms iteration = 6 status = {"expiration":"2024-12-06T02:37:00.101498369Z","pruned":[]}
15122024-12-06T02:47:00.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
15132024-12-06T02:47:00.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.172885ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15142024-12-06T02:47:00.109ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152024-12-06T02:47:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15162024-12-06T02:47:00.111ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15172024-12-06T02:47:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15182024-12-06T02:47:00.122ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15192024-12-06T02:47:00.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15202024-12-06T02:47:00.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15212024-12-06T02:47:00.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-12-06T02:47:00.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15232024-12-06T02:47:00.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15242024-12-06T02:47:00.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15252024-12-06T02:47:00.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15262024-12-06T02:47:00.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15272024-12-06T02:47:00.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15282024-12-06T02:47:00.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15292024-12-06T02:47:00.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15302024-12-06T02:47:00.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15312024-12-06T02:47:00.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15322024-12-06T02:47:00.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15332024-12-06T02:47:00.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15342024-12-06T02:47:00.145ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5968, tv_nsec: 511998935 } })
15352024-12-06T02:47:00.145ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
15362024-12-06T02:47:00.148ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 46.146757ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
15372024-12-06T02:47:00.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15382024-12-06T02:47:00.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15392024-12-06T02:47:00.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402024-12-06T02:47:00.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15412024-12-06T02:47:00.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15422024-12-06T02:47:00.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15432024-12-06T02:47:00.198ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15442024-12-06T02:47:00.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15452024-12-06T02:47:00.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-12-06T02:47:00.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15472024-12-06T02:47:00.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15482024-12-06T02:47:00.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492024-12-06T02:47:00.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15502024-12-06T02:47:00.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15512024-12-06T02:47:00.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15522024-12-06T02:47:00.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15532024-12-06T02:47:00.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15542024-12-06T02:47:00.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15552024-12-06T02:47:00.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15562024-12-06T02:47:00.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15572024-12-06T02:47:00.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15582024-12-06T02:47:00.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15592024-12-06T02:47:00.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15602024-12-06T02:47:00.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15612024-12-06T02:47:00.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 107.52246ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
15622024-12-06T02:47:00.212ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.974649ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15632024-12-06T02:47:00.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15642024-12-06T02:47:00.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-12-06T02:47:00.217ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15662024-12-06T02:47:00.217ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15672024-12-06T02:47:00.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
15682024-12-06T02:47:00.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15692024-12-06T02:47:00.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15702024-12-06T02:47:00.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15712024-12-06T02:47:00.218ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15722024-12-06T02:47:00.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15732024-12-06T02:47:00.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15742024-12-06T02:47:00.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15752024-12-06T02:47:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15762024-12-06T02:47:00.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.397789ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15772024-12-06T02:47:00.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.552184ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15782024-12-06T02:47:00.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15792024-12-06T02:47:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15802024-12-06T02:47:00.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812024-12-06T02:47:00.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15822024-12-06T02:47:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15832024-12-06T02:47:00.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15842024-12-06T02:47:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15852024-12-06T02:47:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15862024-12-06T02:47:00.233ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15872024-12-06T02:47:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15882024-12-06T02:47:00.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15892024-12-06T02:47:00.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-12-06T02:47:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15912024-12-06T02:47:00.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 134.010427ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
15922024-12-06T02:47:00.236ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15932024-12-06T02:47:00.236ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15942024-12-06T02:47:00.236ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 134.497141ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15952024-12-06T02:47:00.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5968, tv_nsec: 604481157 } })
15962024-12-06T02:47:00.237ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15972024-12-06T02:47:00.237ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15982024-12-06T02:47:00.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15992024-12-06T02:47:00.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16002024-12-06T02:47:00.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
16012024-12-06T02:47:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16022024-12-06T02:47:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16032024-12-06T02:47:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
16042024-12-06T02:47:00.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16052024-12-06T02:47:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16062024-12-06T02:47:00.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16072024-12-06T02:47:00.243ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16082024-12-06T02:47:00.243ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16092024-12-06T02:47:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 142.398896ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16102024-12-06T02:47:00.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16112024-12-06T02:47:00.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16122024-12-06T02:47:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16132024-12-06T02:47:00.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16142024-12-06T02:47:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16152024-12-06T02:47:00.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16162024-12-06T02:47:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16172024-12-06T02:47:00.248ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
16182024-12-06T02:47:00.248ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 147.305206ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
16192024-12-06T02:47:00.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16202024-12-06T02:47:00.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
16212024-12-06T02:47:00.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16222024-12-06T02:47:00.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16232024-12-06T02:47:00.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16242024-12-06T02:47:00.257ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 156.177941ms iteration = 11 status = 0
16252024-12-06T02:47:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16262024-12-06T02:47:00.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16272024-12-06T02:47:00.258ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16282024-12-06T02:47:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16292024-12-06T02:47:00.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-12-06T02:47:00.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312024-12-06T02:47:00.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16322024-12-06T02:47:00.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16332024-12-06T02:47:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16342024-12-06T02:47:00.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16352024-12-06T02:47:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16362024-12-06T02:47:00.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16372024-12-06T02:47:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16382024-12-06T02:47:00.271ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16392024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16402024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16412024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16422024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16432024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16442024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16452024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16462024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16472024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16482024-12-06T02:47:00.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16492024-12-06T02:47:00.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16502024-12-06T02:47:00.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16512024-12-06T02:47:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16522024-12-06T02:47:00.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16532024-12-06T02:47:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16542024-12-06T02:47:00.281ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16552024-12-06T02:47:00.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16562024-12-06T02:47:00.285ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16572024-12-06T02:47:00.285ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 183.388267ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16582024-12-06T02:47:00.289ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16592024-12-06T02:47:00.289ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16602024-12-06T02:47:00.289ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16612024-12-06T02:47:00.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16622024-12-06T02:47:00.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16632024-12-06T02:47:00.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16642024-12-06T02:47:00.292ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16652024-12-06T02:47:00.292ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16662024-12-06T02:47:00.293ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9926ce2b-54a0-44e2-90d8-e5874213cdc7", "content-length": "26", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
16672024-12-06T02:47:00.293ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16682024-12-06T02:47:00.293ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16692024-12-06T02:47:00.293ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16702024-12-06T02:47:00.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16712024-12-06T02:47:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16722024-12-06T02:47:00.294ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16732024-12-06T02:47:00.294ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16742024-12-06T02:47:00.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16752024-12-06T02:47:00.295ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b236e9af-c23c-4c29-9491-e42162a9387a", "content-length": "26", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
16762024-12-06T02:47:00.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16772024-12-06T02:47:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16782024-12-06T02:47:00.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16792024-12-06T02:47:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16802024-12-06T02:47:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16812024-12-06T02:47:00.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16822024-12-06T02:47:00.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16832024-12-06T02:47:00.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16842024-12-06T02:47:00.297ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16852024-12-06T02:47:00.297ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
16862024-12-06T02:47:00.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16872024-12-06T02:47:00.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16882024-12-06T02:47:00.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16892024-12-06T02:47:00.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
16902024-12-06T02:47:00.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16912024-12-06T02:47:00.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16922024-12-06T02:47:00.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16932024-12-06T02:47:00.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16942024-12-06T02:47:00.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16952024-12-06T02:47:00.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16962024-12-06T02:47:00.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16972024-12-06T02:47:00.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16982024-12-06T02:47:00.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16992024-12-06T02:47:00.306ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
17002024-12-06T02:47:00.306ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17012024-12-06T02:47:00.306ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
17022024-12-06T02:47:00.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 204.83171ms iteration = 7 status = {"generation":2}
17032024-12-06T02:47:00.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17042024-12-06T02:47:00.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17052024-12-06T02:47:00.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17062024-12-06T02:47:00.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17072024-12-06T02:47:00.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17082024-12-06T02:47:00.312ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 210.405569ms iteration = 14 status = {"physical_disks_added":0}
17092024-12-06T02:47:00.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17102024-12-06T02:47:00.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17112024-12-06T02:47:00.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17122024-12-06T02:47:00.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17132024-12-06T02:47:00.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17142024-12-06T02:47:00.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17152024-12-06T02:47:00.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17162024-12-06T02:47:00.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17172024-12-06T02:47:00.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17182024-12-06T02:47:00.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17192024-12-06T02:47:00.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17202024-12-06T02:47:00.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17212024-12-06T02:47:00.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17222024-12-06T02:47:00.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 226.788728ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17232024-12-06T02:47:00.329ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17242024-12-06T02:47:00.329ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17252024-12-06T02:47:00.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17262024-12-06T02:47:00.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17272024-12-06T02:47:00.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17282024-12-06T02:47:00.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17292024-12-06T02:47:00.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17302024-12-06T02:47:00.332ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17312024-12-06T02:47:00.332ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17322024-12-06T02:47:00.332ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 230.924746ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17332024-12-06T02:47:00.335ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17342024-12-06T02:47:00.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17352024-12-06T02:47:00.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17362024-12-06T02:47:00.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17372024-12-06T02:47:00.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17382024-12-06T02:47:00.337ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17392024-12-06T02:47:00.337ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 236.026651ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17402024-12-06T02:47:00.338ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17412024-12-06T02:47:00.338ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17422024-12-06T02:47:00.338ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
17432024-12-06T02:47:00.338ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 237.034389ms iteration = 7 status = {"generation":1}
17442024-12-06T02:47:00.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17452024-12-06T02:47:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17462024-12-06T02:47:00.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17472024-12-06T02:47:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17482024-12-06T02:47:00.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17492024-12-06T02:47:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17502024-12-06T02:47:00.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17512024-12-06T02:47:00.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17522024-12-06T02:47:00.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-12-06T02:47:00.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
17542024-12-06T02:47:00.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17552024-12-06T02:47:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17562024-12-06T02:47:00.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17572024-12-06T02:47:00.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17582024-12-06T02:47:00.376ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59293
17592024-12-06T02:47:00.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59293 req_id = 02c6d01e-0fa5-4c55-914f-29a9190071e2 roles = RoleSet { roles: {} } uri = /metrics/producers
17602024-12-06T02:47:00.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59293 req_id = 02c6d01e-0fa5-4c55-914f-29a9190071e2 resource = Database result = Ok(()) uri = /metrics/producers
17612024-12-06T02:47:00.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17622024-12-06T02:47:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17632024-12-06T02:47:00.379ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
17642024-12-06T02:47:00.379ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 278.072413ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17652024-12-06T02:47:00.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662024-12-06T02:47:00.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
17672024-12-06T02:47:00.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17682024-12-06T02:47:00.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17692024-12-06T02:47:00.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17702024-12-06T02:47:00.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17712024-12-06T02:47:00.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17722024-12-06T02:47:00.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17732024-12-06T02:47:00.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17742024-12-06T02:47:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17752024-12-06T02:47:00.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17762024-12-06T02:47:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17772024-12-06T02:47:00.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17782024-12-06T02:47:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17792024-12-06T02:47:00.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17802024-12-06T02:47:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17812024-12-06T02:47:00.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17822024-12-06T02:47:00.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17832024-12-06T02:47:00.439ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17842024-12-06T02:47:00.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17852024-12-06T02:47:00.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bfa0b8e4-7b9f-4d27-8224-e02be6188601", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17862024-12-06T02:47:00.440ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17872024-12-06T02:47:00.442ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "12bd55b0-10de-4629-8d28-4e8d13b3a263", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17882024-12-06T02:47:00.442ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17892024-12-06T02:47:00.444ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17902024-12-06T02:47:00.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 342.863003ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17912024-12-06T02:47:00.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
17922024-12-06T02:47:00.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17932024-12-06T02:47:00.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17942024-12-06T02:47:00.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17952024-12-06T02:47:00.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17962024-12-06T02:47:00.446ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17972024-12-06T02:47:00.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17982024-12-06T02:47:00.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d27691-ce7e-4559-a2a8-bf6d782b785d", "content-length": "372", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
17992024-12-06T02:47:00.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18002024-12-06T02:47:00.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18012024-12-06T02:47:00.447ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 6379dfe0-2a46-4638-967d-13828cc17f6c
18022024-12-06T02:47:00.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18032024-12-06T02:47:00.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71257 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59293 req_id = 02c6d01e-0fa5-4c55-914f-29a9190071e2 response_code = 201 uri = /metrics/producers
18042024-12-06T02:47:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18052024-12-06T02:47:00.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062024-12-06T02:47:00.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
18072024-12-06T02:47:00.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18082024-12-06T02:47:00.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18092024-12-06T02:47:00.459ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
18102024-12-06T02:47:00.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18112024-12-06T02:47:00.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18122024-12-06T02:47:00.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18132024-12-06T02:47:00.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
18142024-12-06T02:47:00.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18152024-12-06T02:47:00.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18162024-12-06T02:47:00.464ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
18172024-12-06T02:47:00.465ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
18182024-12-06T02:47:00.465ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
18192024-12-06T02:47:00.490ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18202024-12-06T02:47:00.490ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5c4f130-bed9-4f7a-a6df-5d9a2807dc4d", "content-length": "1", "date": "Fri, 06 Dec 2024 02:46:59 GMT"} })
18212024-12-06T02:47:00.493ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18222024-12-06T02:47:00.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18232024-12-06T02:47:00.495ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.86548ms iteration = 11 status = null
18242024-12-06T02:47:00.504ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
18252024-12-06T02:47:00.504ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18262024-12-06T02:47:00.504ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "951c64c2-4fa6-4835-aa22-02a69e0bb0d4", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18272024-12-06T02:47:00.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18282024-12-06T02:47:00.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18292024-12-06T02:47:00.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18302024-12-06T02:47:00.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18312024-12-06T02:47:00.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18322024-12-06T02:47:00.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18332024-12-06T02:47:00.514ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18342024-12-06T02:47:00.514ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18352024-12-06T02:47:00.514ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "031667ed-9424-4cc1-bff6-41f5a4192343", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18362024-12-06T02:47:00.516ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.274261ms iteration = 12 status = {}
18372024-12-06T02:47:00.524ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5455a27f-b1dd-4d8d-adde-726221dabebe, time_created: 2024-12-06T02:42:27.098106Z, time_modified: 2024-12-06T02:42:27.098106Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
18382024-12-06T02:47:00.524ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
18392024-12-06T02:47:00.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18402024-12-06T02:47:00.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18412024-12-06T02:47:00.526ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18422024-12-06T02:47:00.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18432024-12-06T02:47:00.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18442024-12-06T02:47:00.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
18452024-12-06T02:47:00.536ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
18462024-12-06T02:47:00.536ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18472024-12-06T02:47:00.536ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9618536a-a4e3-4794-bd35-b5f284d97d2c", "content-length": "26", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18482024-12-06T02:47:00.536ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18492024-12-06T02:47:00.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
18502024-12-06T02:47:00.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
18512024-12-06T02:47:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 470.624292ms iteration = 11 status = {}
18522024-12-06T02:47:00.602ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18532024-12-06T02:47:00.603ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c67de520-1cb2-47be-bf46-760f11dbf052", "content-length": "691", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18542024-12-06T02:47:00.603ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
18552024-12-06T02:47:00.603ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
18562024-12-06T02:47:00.603ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
18572024-12-06T02:47:00.605ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 503.626345ms iteration = 11 status = {}
18582024-12-06T02:47:00.632ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18592024-12-06T02:47:00.632ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6c3465b7-3e5f-412c-b3da-28bbee7ddfa9", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18602024-12-06T02:47:00.635ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
18612024-12-06T02:47:00.635ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 533.351524ms
18622024-12-06T02:47:00.635ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 533.362374ms iteration = 2 status = {}
18632024-12-06T02:47:00.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
18642024-12-06T02:47:00.642ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cf569789-ad20-45ca-a874-8340fc7d31f5", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18652024-12-06T02:47:00.642ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18662024-12-06T02:47:00.644ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "97d56014-239d-48c4-ad68-e279d5089c2a", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18672024-12-06T02:47:00.644ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18682024-12-06T02:47:00.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "98491e7f-fbd6-4926-955a-a34e045caea0", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18692024-12-06T02:47:00.645ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18702024-12-06T02:47:00.647ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
18712024-12-06T02:47:00.647ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 545.297105ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18722024-12-06T02:47:00.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18732024-12-06T02:47:00.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18742024-12-06T02:47:00.701ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47247
18752024-12-06T02:47:00.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47247 req_id = 63c697ba-4381-4af9-a2fe-7d0bc8f0ffea roles = RoleSet { roles: {} } uri = /metrics/producers
18762024-12-06T02:47:00.702ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
18772024-12-06T02:47:00.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18782024-12-06T02:47:00.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47247 req_id = 63c697ba-4381-4af9-a2fe-7d0bc8f0ffea resource = Database result = Ok(()) uri = /metrics/producers
18792024-12-06T02:47:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18802024-12-06T02:47:00.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18812024-12-06T02:47:00.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f5ba8e7-9db3-4e79-b60c-3c4754192770", "content-length": "134", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18822024-12-06T02:47:00.719ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18832024-12-06T02:47:00.719ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
18842024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18852024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18862024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18872024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18882024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18892024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18902024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18912024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18922024-12-06T02:47:00.720ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
18932024-12-06T02:47:00.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18942024-12-06T02:47:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18952024-12-06T02:47:00.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18962024-12-06T02:47:00.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ecde58b-d3e0-4af1-881e-5929b8d198cc", "content-length": "2", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18972024-12-06T02:47:00.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18982024-12-06T02:47:00.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6a2574-fb5e-47a2-81ce-97f5adab55ac", "content-length": "52", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
18992024-12-06T02:47:00.722ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
19002024-12-06T02:47:00.722ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19012024-12-06T02:47:00.756ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3c6a3a2f-feb7-45e4-8652-d9c5f1a56f83
19022024-12-06T02:47:00.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54129 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47247 req_id = 63c697ba-4381-4af9-a2fe-7d0bc8f0ffea response_code = 201 uri = /metrics/producers
19032024-12-06T02:47:00.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 91f75d8d-62b9-4ba7-847e-d1b9f8f82351 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19042024-12-06T02:47:00.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 91f75d8d-62b9-4ba7-847e-d1b9f8f82351 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19052024-12-06T02:47:00.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 91f75d8d-62b9-4ba7-847e-d1b9f8f82351 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19062024-12-06T02:47:00.983ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "826a1cee-f653-4124-97ec-d85391353f6a", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
19072024-12-06T02:47:00.983ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
19082024-12-06T02:47:00.983ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19092024-12-06T02:47:00.984ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc40c23-50ae-47cb-a628-0dabe081adb1", "content-length": "682", "date": "Fri, 06 Dec 2024 02:47:00 GMT"} })
19102024-12-06T02:47:00.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19112024-12-06T02:47:00.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19122024-12-06T02:47:00.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19132024-12-06T02:47:00.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19142024-12-06T02:47:00.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19152024-12-06T02:47:00.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19162024-12-06T02:47:00.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19172024-12-06T02:47:00.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19182024-12-06T02:47:00.999ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 897.895687ms iteration = 11 status = {}
19192024-12-06T02:47:01.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 2e537338-bae9-4dcc-b69c-d3dee335d262 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19202024-12-06T02:47:01.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 2e537338-bae9-4dcc-b69c-d3dee335d262 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19212024-12-06T02:47:01.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 2e537338-bae9-4dcc-b69c-d3dee335d262 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19222024-12-06T02:47:01.800ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52128
19232024-12-06T02:47:01.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52128 req_id = 77c3626a-5db9-41b3-8f4a-80d43a47a8d5 roles = RoleSet { roles: {} } uri = /metrics/producers
19242024-12-06T02:47:01.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52128 req_id = 77c3626a-5db9-41b3-8f4a-80d43a47a8d5 resource = Database result = Ok(()) uri = /metrics/producers
19252024-12-06T02:47:01.812ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 51153a4a-2459-4cf7-8ef8-603fcdf9d4a3
19262024-12-06T02:47:01.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12359 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52128 req_id = 77c3626a-5db9-41b3-8f4a-80d43a47a8d5 response_code = 201 uri = /metrics/producers
19272024-12-06T02:47:01.854ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35405
19282024-12-06T02:47:01.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 888c2898-1847-46be-b84d-e79e56b27ef5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19292024-12-06T02:47:01.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 888c2898-1847-46be-b84d-e79e56b27ef5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19302024-12-06T02:47:01.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35405 req_id = c3b85603-45f6-4c19-ace2-8fbe3f6c4da5 roles = RoleSet { roles: {} } uri = /metrics/producers
19312024-12-06T02:47:01.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35405 req_id = c3b85603-45f6-4c19-ace2-8fbe3f6c4da5 resource = Database result = Ok(()) uri = /metrics/producers
19322024-12-06T02:47:01.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 888c2898-1847-46be-b84d-e79e56b27ef5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19332024-12-06T02:47:01.900ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
19342024-12-06T02:47:01.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45686 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35405 req_id = c3b85603-45f6-4c19-ace2-8fbe3f6c4da5 response_code = 201 uri = /metrics/producers
19352024-12-06T02:47:02.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 638d7d29-1087-469e-86a5-9c4c4019f50d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19362024-12-06T02:47:02.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 638d7d29-1087-469e-86a5-9c4c4019f50d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19372024-12-06T02:47:02.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 638d7d29-1087-469e-86a5-9c4c4019f50d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19382024-12-06T02:47:03.416ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45137
19392024-12-06T02:47:03.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45137 req_id = ceafed8d-e6b0-4564-b269-7267dade2946 roles = RoleSet { roles: {} } uri = /metrics/producers
19402024-12-06T02:47:03.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45137 req_id = ceafed8d-e6b0-4564-b269-7267dade2946 resource = Database result = Ok(()) uri = /metrics/producers
19412024-12-06T02:47:03.452ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 37960cb7-3354-4d05-b7eb-4cf4f416256d
19422024-12-06T02:47:03.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36192 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45137 req_id = ceafed8d-e6b0-4564-b269-7267dade2946 response_code = 201 uri = /metrics/producers
19432024-12-06T02:47:03.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c5de540d-307a-46cc-8025-66158dbeb45e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19442024-12-06T02:47:03.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c5de540d-307a-46cc-8025-66158dbeb45e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19452024-12-06T02:47:03.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c5de540d-307a-46cc-8025-66158dbeb45e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19462024-12-06T02:47:04.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d71ba7dc-30e6-4135-8d49-877e27cc5b9e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19472024-12-06T02:47:04.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d71ba7dc-30e6-4135-8d49-877e27cc5b9e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19482024-12-06T02:47:04.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d71ba7dc-30e6-4135-8d49-877e27cc5b9e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19492024-12-06T02:47:05.027ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1199 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 85ba3e7f-6ab9-40ed-859a-dbfef40cb180 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
19502024-12-06T02:47:05.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90da456e-b2bf-4a01-b818-0f5837dd178a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19512024-12-06T02:47:05.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90da456e-b2bf-4a01-b818-0f5837dd178a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19522024-12-06T02:47:05.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90da456e-b2bf-4a01-b818-0f5837dd178a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19532024-12-06T02:47:06.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 863b46bd-fc97-4302-a587-2cbc3120522e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19542024-12-06T02:47:06.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 863b46bd-fc97-4302-a587-2cbc3120522e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19552024-12-06T02:47:06.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 863b46bd-fc97-4302-a587-2cbc3120522e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19562024-12-06T02:47:07.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 39faa58e-73bd-44a3-b588-6ef5bd096be6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19572024-12-06T02:47:07.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 39faa58e-73bd-44a3-b588-6ef5bd096be6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19582024-12-06T02:47:07.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 39faa58e-73bd-44a3-b588-6ef5bd096be6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19592024-12-06T02:47:09.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2ebec2bb-3a60-45d7-8469-8e6ae98c23af roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19602024-12-06T02:47:09.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2ebec2bb-3a60-45d7-8469-8e6ae98c23af resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19612024-12-06T02:47:09.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2ebec2bb-3a60-45d7-8469-8e6ae98c23af response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19622024-12-06T02:47:10.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75b15e67-31be-4ffe-920f-ea856cd0363b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19632024-12-06T02:47:10.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75b15e67-31be-4ffe-920f-ea856cd0363b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19642024-12-06T02:47:10.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75b15e67-31be-4ffe-920f-ea856cd0363b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19652024-12-06T02:47:10.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
19662024-12-06T02:47:10.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19672024-12-06T02:47:10.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
19682024-12-06T02:47:10.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19692024-12-06T02:47:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19702024-12-06T02:47:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19712024-12-06T02:47:10.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19722024-12-06T02:47:10.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19732024-12-06T02:47:10.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19742024-12-06T02:47:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19752024-12-06T02:47:10.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19762024-12-06T02:47:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19772024-12-06T02:47:10.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19782024-12-06T02:47:10.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19792024-12-06T02:47:10.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19802024-12-06T02:47:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
19812024-12-06T02:47:10.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19822024-12-06T02:47:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19832024-12-06T02:47:10.121ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
19842024-12-06T02:47:10.121ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.479084ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
19852024-12-06T02:47:10.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.246ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19862024-12-06T02:47:11.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e1c6464-904d-4b74-a3b3-9006a93a5bb1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19872024-12-06T02:47:11.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e1c6464-904d-4b74-a3b3-9006a93a5bb1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19882024-12-06T02:47:11.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e1c6464-904d-4b74-a3b3-9006a93a5bb1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19892024-12-06T02:47:12.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 831f4868-5943-421d-9976-6a38acaf877f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19902024-12-06T02:47:12.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 831f4868-5943-421d-9976-6a38acaf877f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19912024-12-06T02:47:12.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 831f4868-5943-421d-9976-6a38acaf877f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19922024-12-06T02:47:13.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b87c9bea-efb9-456c-9501-6879842b7710 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19932024-12-06T02:47:13.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b87c9bea-efb9-456c-9501-6879842b7710 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19942024-12-06T02:47:13.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b87c9bea-efb9-456c-9501-6879842b7710 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19952024-12-06T02:47:14.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bd1eaf60-5209-47a6-b1ab-35c5cd45a1e9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19962024-12-06T02:47:14.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bd1eaf60-5209-47a6-b1ab-35c5cd45a1e9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19972024-12-06T02:47:14.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bd1eaf60-5209-47a6-b1ab-35c5cd45a1e9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
19982024-12-06T02:47:15.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1328 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = a7e89ee5-4889-412e-91be-0c9f83034500 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
19992024-12-06T02:47:15.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a6264b20-ece7-4a96-b9d7-bc4d7bd6eed5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20002024-12-06T02:47:15.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a6264b20-ece7-4a96-b9d7-bc4d7bd6eed5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20012024-12-06T02:47:15.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a6264b20-ece7-4a96-b9d7-bc4d7bd6eed5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20022024-12-06T02:47:16.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0a6e8adc-27fa-4d31-a727-dd861f3cfe65 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20032024-12-06T02:47:16.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0a6e8adc-27fa-4d31-a727-dd861f3cfe65 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20042024-12-06T02:47:16.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0a6e8adc-27fa-4d31-a727-dd861f3cfe65 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20052024-12-06T02:47:17.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d5d46416-bc4d-48d3-b747-cf781038db56 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20062024-12-06T02:47:17.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d5d46416-bc4d-48d3-b747-cf781038db56 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20072024-12-06T02:47:17.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d5d46416-bc4d-48d3-b747-cf781038db56 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20082024-12-06T02:47:17.863ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64394
20092024-12-06T02:47:17.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64394 req_id = 1ce0ea14-76b4-480c-829a-b017bd6399b4 roles = RoleSet { roles: {} } uri = /metrics/producers
20102024-12-06T02:47:17.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64394 req_id = 1ce0ea14-76b4-480c-829a-b017bd6399b4 resource = Database result = Ok(()) uri = /metrics/producers
20112024-12-06T02:47:17.875ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 2dbba7e1-9c13-427e-a69e-72040b07d167
20122024-12-06T02:47:17.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11310 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64394 req_id = 1ce0ea14-76b4-480c-829a-b017bd6399b4 response_code = 201 uri = /metrics/producers
20132024-12-06T02:47:18.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d3d510fa-4b1e-46aa-8af5-62d0199f87b0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20142024-12-06T02:47:18.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d3d510fa-4b1e-46aa-8af5-62d0199f87b0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20152024-12-06T02:47:18.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d3d510fa-4b1e-46aa-8af5-62d0199f87b0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20162024-12-06T02:47:19.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8833224f-f773-4a9c-a743-7d61484d62fa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20172024-12-06T02:47:19.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8833224f-f773-4a9c-a743-7d61484d62fa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20182024-12-06T02:47:19.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8833224f-f773-4a9c-a743-7d61484d62fa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20192024-12-06T02:47:20.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
20202024-12-06T02:47:20.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
20212024-12-06T02:47:20.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20222024-12-06T02:47:20.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20232024-12-06T02:47:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20242024-12-06T02:47:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20252024-12-06T02:47:20.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262024-12-06T02:47:20.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20272024-12-06T02:47:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20282024-12-06T02:47:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20292024-12-06T02:47:20.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20302024-12-06T02:47:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20312024-12-06T02:47:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20322024-12-06T02:47:20.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20332024-12-06T02:47:20.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342024-12-06T02:47:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
20352024-12-06T02:47:20.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20362024-12-06T02:47:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20372024-12-06T02:47:20.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
20382024-12-06T02:47:20.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.003995ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
20392024-12-06T02:47:20.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.392056ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20402024-12-06T02:47:20.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93eface9-346d-48f7-b9ee-ce226e8999db roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20412024-12-06T02:47:20.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93eface9-346d-48f7-b9ee-ce226e8999db resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20422024-12-06T02:47:20.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93eface9-346d-48f7-b9ee-ce226e8999db response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20432024-12-06T02:47:21.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 947d9bc6-9e7f-40c8-859c-cf969de607b1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20442024-12-06T02:47:21.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 947d9bc6-9e7f-40c8-859c-cf969de607b1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20452024-12-06T02:47:21.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 947d9bc6-9e7f-40c8-859c-cf969de607b1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20462024-12-06T02:47:22.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2ecc1d7b-e642-4fe9-bdd9-c198f113fec9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20472024-12-06T02:47:22.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2ecc1d7b-e642-4fe9-bdd9-c198f113fec9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20482024-12-06T02:47:22.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2ecc1d7b-e642-4fe9-bdd9-c198f113fec9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20492024-12-06T02:47:23.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d0ca78a6-f8e9-403f-a6e9-48be045a3851 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20502024-12-06T02:47:23.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d0ca78a6-f8e9-403f-a6e9-48be045a3851 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20512024-12-06T02:47:23.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d0ca78a6-f8e9-403f-a6e9-48be045a3851 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20522024-12-06T02:47:24.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8122bd6b-6e34-44b5-9d70-b363f7004119 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20532024-12-06T02:47:24.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8122bd6b-6e34-44b5-9d70-b363f7004119 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20542024-12-06T02:47:24.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8122bd6b-6e34-44b5-9d70-b363f7004119 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20552024-12-06T02:47:25.027ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1197 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 716b0f87-7b2a-408e-b365-88f757a4c28a response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
20562024-12-06T02:47:25.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c17768f4-1402-4bc1-8134-3aebbdba3ce1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20572024-12-06T02:47:25.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c17768f4-1402-4bc1-8134-3aebbdba3ce1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20582024-12-06T02:47:25.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c17768f4-1402-4bc1-8134-3aebbdba3ce1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20592024-12-06T02:47:26.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e5fe3e2f-d102-4228-a141-5823d88687a6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20602024-12-06T02:47:26.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e5fe3e2f-d102-4228-a141-5823d88687a6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20612024-12-06T02:47:26.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e5fe3e2f-d102-4228-a141-5823d88687a6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20622024-12-06T02:47:27.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eb32a343-e2e0-421b-b949-8f5a272edd14 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20632024-12-06T02:47:27.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eb32a343-e2e0-421b-b949-8f5a272edd14 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20642024-12-06T02:47:27.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eb32a343-e2e0-421b-b949-8f5a272edd14 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20652024-12-06T02:47:28.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9aab36f2-fc6b-4856-965c-17f630cd23e7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20662024-12-06T02:47:28.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9aab36f2-fc6b-4856-965c-17f630cd23e7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20672024-12-06T02:47:28.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9aab36f2-fc6b-4856-965c-17f630cd23e7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20682024-12-06T02:47:29.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1cd0e1fd-7682-49a8-98c4-b7dc153cec9d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20692024-12-06T02:47:29.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1cd0e1fd-7682-49a8-98c4-b7dc153cec9d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20702024-12-06T02:47:29.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1cd0e1fd-7682-49a8-98c4-b7dc153cec9d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
20712024-12-06T02:47:30.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
20722024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
20732024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20742024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20752024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
20762024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20772024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
20782024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
20792024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20802024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
20812024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20822024-12-06T02:47:30.102ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20832024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20842024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
20852024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20862024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
20872024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
20882024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20892024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
20902024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20912024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
20922024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20932024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
20942024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20952024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20962024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
20972024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20982024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
20992024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21002024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
21012024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21022024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
21032024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21042024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
21052024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21062024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21072024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21082024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21092024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21102024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21112024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21122024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21132024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21142024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21152024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21162024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21172024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21182024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21192024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21202024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21212024-12-06T02:47:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21222024-12-06T02:47:30.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5998, tv_nsec: 476521030 } })
21232024-12-06T02:47:30.110ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
21242024-12-06T02:47:30.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21252024-12-06T02:47:30.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21262024-12-06T02:47:30.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272024-12-06T02:47:30.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21282024-12-06T02:47:30.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21292024-12-06T02:47:30.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21302024-12-06T02:47:30.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21312024-12-06T02:47:30.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21322024-12-06T02:47:30.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21332024-12-06T02:47:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21342024-12-06T02:47:30.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21352024-12-06T02:47:30.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21362024-12-06T02:47:30.119ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 17.803129ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21372024-12-06T02:47:30.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5998, tv_nsec: 489328406 } })
21382024-12-06T02:47:30.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
21392024-12-06T02:47:30.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21402024-12-06T02:47:30.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21412024-12-06T02:47:30.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21422024-12-06T02:47:30.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21432024-12-06T02:47:30.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21442024-12-06T02:47:30.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21452024-12-06T02:47:30.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21462024-12-06T02:47:30.185ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21472024-12-06T02:47:30.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21482024-12-06T02:47:30.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21492024-12-06T02:47:30.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21502024-12-06T02:47:30.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21512024-12-06T02:47:30.190ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5998, tv_nsec: 557635287 } })
21522024-12-06T02:47:30.190ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21532024-12-06T02:47:30.190ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21542024-12-06T02:47:30.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21552024-12-06T02:47:30.191ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
21562024-12-06T02:47:30.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21572024-12-06T02:47:30.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.190418ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
21582024-12-06T02:47:30.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 92.394529ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
21592024-12-06T02:47:30.195ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21602024-12-06T02:47:30.195ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21612024-12-06T02:47:30.195ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80773424-9dd5-4c2c-a6fe-47cc254ccc18", "content-length": "26", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
21622024-12-06T02:47:30.195ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21632024-12-06T02:47:30.198ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21642024-12-06T02:47:30.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21652024-12-06T02:47:30.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21662024-12-06T02:47:30.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21672024-12-06T02:47:30.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21682024-12-06T02:47:30.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21692024-12-06T02:47:30.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21702024-12-06T02:47:30.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21712024-12-06T02:47:30.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.462807ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21722024-12-06T02:47:30.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21732024-12-06T02:47:30.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21742024-12-06T02:47:30.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21752024-12-06T02:47:30.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21762024-12-06T02:47:30.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21772024-12-06T02:47:30.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21782024-12-06T02:47:30.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21792024-12-06T02:47:30.207ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21802024-12-06T02:47:30.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21812024-12-06T02:47:30.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21822024-12-06T02:47:30.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21832024-12-06T02:47:30.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842024-12-06T02:47:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852024-12-06T02:47:30.217ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21862024-12-06T02:47:30.217ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.879293ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21872024-12-06T02:47:30.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21882024-12-06T02:47:30.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21892024-12-06T02:47:30.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21902024-12-06T02:47:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
21912024-12-06T02:47:30.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21922024-12-06T02:47:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21932024-12-06T02:47:30.226ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21942024-12-06T02:47:30.227ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21952024-12-06T02:47:30.227ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32ec58c2-b0cb-4b6e-8e7d-40d1b71f1558", "content-length": "26", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
21962024-12-06T02:47:30.227ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21972024-12-06T02:47:30.232ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21982024-12-06T02:47:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 133.800882ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21992024-12-06T02:47:30.240ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22002024-12-06T02:47:30.240ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22012024-12-06T02:47:30.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22022024-12-06T02:47:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22032024-12-06T02:47:30.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 145.087725ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22042024-12-06T02:47:30.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22052024-12-06T02:47:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22062024-12-06T02:47:30.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
22072024-12-06T02:47:30.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 158.801436ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
22082024-12-06T02:47:30.262ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22092024-12-06T02:47:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22102024-12-06T02:47:30.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22112024-12-06T02:47:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22122024-12-06T02:47:30.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22132024-12-06T02:47:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22142024-12-06T02:47:30.288ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22152024-12-06T02:47:30.288ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22162024-12-06T02:47:30.288ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.276991ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22172024-12-06T02:47:30.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 206.505809ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22182024-12-06T02:47:30.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22192024-12-06T02:47:30.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
22202024-12-06T02:47:30.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22212024-12-06T02:47:30.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22222024-12-06T02:47:30.338ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 236.790184ms iteration = 15 status = {"physical_disks_added":0}
22232024-12-06T02:47:30.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22242024-12-06T02:47:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22252024-12-06T02:47:30.361ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 259.742429ms iteration = 12 status = {}
22262024-12-06T02:47:30.391ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22272024-12-06T02:47:30.391ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22282024-12-06T02:47:30.392ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf75ce8b-c3c3-459b-abb5-151b283944ab", "content-length": "372", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22292024-12-06T02:47:30.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22302024-12-06T02:47:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22312024-12-06T02:47:30.393ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 291.597819ms iteration = 12 status = 0
22322024-12-06T02:47:30.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
22332024-12-06T02:47:30.398ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22342024-12-06T02:47:30.398ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f29e73cb-e0d9-42a7-bbe7-103079347957", "content-length": "26", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22352024-12-06T02:47:30.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22362024-12-06T02:47:30.399ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22372024-12-06T02:47:30.400ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ef74c5-c1f9-4880-8c0c-2527026a2959", "content-length": "1", "date": "Fri, 06 Dec 2024 02:47:29 GMT"} })
22382024-12-06T02:47:30.400ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
22392024-12-06T02:47:30.401ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22402024-12-06T02:47:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22412024-12-06T02:47:30.404ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 302.274734ms iteration = 12 status = null
22422024-12-06T02:47:30.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22432024-12-06T02:47:30.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22442024-12-06T02:47:30.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22452024-12-06T02:47:30.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22462024-12-06T02:47:30.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22472024-12-06T02:47:30.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22482024-12-06T02:47:30.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22492024-12-06T02:47:30.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22502024-12-06T02:47:30.436ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22512024-12-06T02:47:30.436ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22522024-12-06T02:47:30.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b8a33dfe-e749-4d9f-b7e8-1ae97915f2cd", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22532024-12-06T02:47:30.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22542024-12-06T02:47:30.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22552024-12-06T02:47:30.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22562024-12-06T02:47:30.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22572024-12-06T02:47:30.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22582024-12-06T02:47:30.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22592024-12-06T02:47:30.451ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22602024-12-06T02:47:30.451ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22612024-12-06T02:47:30.451ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff3e70c4-f06a-4a6f-b1b8-44dc00f21b80", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22622024-12-06T02:47:30.454ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 352.013565ms iteration = 13 status = {}
22632024-12-06T02:47:30.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22642024-12-06T02:47:30.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22652024-12-06T02:47:30.507ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
22662024-12-06T02:47:30.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22672024-12-06T02:47:30.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22682024-12-06T02:47:30.532ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22692024-12-06T02:47:30.541ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22702024-12-06T02:47:30.542ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "18aecae5-9fbf-4bf4-846b-25ed94aa5813", "content-length": "134", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22712024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22722024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
22732024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22742024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22752024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22762024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22772024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22782024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22792024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22802024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22812024-12-06T02:47:30.542ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
22822024-12-06T02:47:30.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22832024-12-06T02:47:30.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22842024-12-06T02:47:30.545ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22852024-12-06T02:47:30.545ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "95cb91c8-d5d0-4a06-b2c7-099b206b645f", "content-length": "2", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22862024-12-06T02:47:30.545ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22872024-12-06T02:47:30.545ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "62508162-232d-49f8-a1b2-4a6142caf576", "content-length": "52", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22882024-12-06T02:47:30.545ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
22892024-12-06T02:47:30.545ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22902024-12-06T02:47:30.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7473c256-3bd8-4296-9415-3a220f4963c6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
22912024-12-06T02:47:30.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7473c256-3bd8-4296-9415-3a220f4963c6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
22922024-12-06T02:47:30.557ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9109323-0059-4d5d-8ed8-21fcc710632c", "content-length": "691", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22932024-12-06T02:47:30.557ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22942024-12-06T02:47:30.557ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22952024-12-06T02:47:30.557ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22962024-12-06T02:47:30.558ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.439147ms iteration = 12 status = {}
22972024-12-06T02:47:30.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7473c256-3bd8-4296-9415-3a220f4963c6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
22982024-12-06T02:47:30.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "077ca328-c9d1-4b05-b5e7-b4c487ebb1ec", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
22992024-12-06T02:47:30.743ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
23002024-12-06T02:47:30.743ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23012024-12-06T02:47:30.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5f7329e-50f3-4596-b341-e06150538c0a", "content-length": "682", "date": "Fri, 06 Dec 2024 02:47:30 GMT"} })
23022024-12-06T02:47:30.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23032024-12-06T02:47:30.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23042024-12-06T02:47:30.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23052024-12-06T02:47:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23062024-12-06T02:47:30.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23072024-12-06T02:47:30.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23082024-12-06T02:47:30.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23092024-12-06T02:47:30.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23102024-12-06T02:47:30.760ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 658.17927ms iteration = 12 status = {}
23112024-12-06T02:47:31.423ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23122024-12-06T02:47:31.423ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
23132024-12-06T02:47:31.454ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
23142024-12-06T02:47:31.454ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:43539
23152024-12-06T02:47:31.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43539 req_id = 2db63be5-9b09-494d-9b23-774bdbd0eadd roles = RoleSet { roles: {} } uri = /metrics/producers
23162024-12-06T02:47:31.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43539 req_id = 2db63be5-9b09-494d-9b23-774bdbd0eadd resource = Database result = Ok(()) uri = /metrics/producers
23172024-12-06T02:47:31.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = fd5ef874-d0d6-45a2-9e7e-fa8669d19548 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23182024-12-06T02:47:31.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = fd5ef874-d0d6-45a2-9e7e-fa8669d19548 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23192024-12-06T02:47:31.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = fd5ef874-d0d6-45a2-9e7e-fa8669d19548 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23202024-12-06T02:47:31.488ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3943088e-6ce0-4ada-925c-494df92c0dda
23212024-12-06T02:47:31.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33947 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43539 req_id = 2db63be5-9b09-494d-9b23-774bdbd0eadd response_code = 201 uri = /metrics/producers
23222024-12-06T02:47:31.488ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2db63be5-9b09-494d-9b23-774bdbd0eadd", "content-length": "41", "date": "Fri, 06 Dec 2024 02:47:31 GMT"} })
23232024-12-06T02:47:31.489ZDEBGnexus (producer-registration-task): registered with nexus successfully
23242024-12-06T02:47:31.489ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23252024-12-06T02:47:31.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ee3c3e02-2d6d-4931-8617-676dbe461565 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23262024-12-06T02:47:31.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ee3c3e02-2d6d-4931-8617-676dbe461565 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23272024-12-06T02:47:31.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ee3c3e02-2d6d-4931-8617-676dbe461565 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23282024-12-06T02:47:32.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50391a36-1cf2-46e9-adae-713810647ccc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23292024-12-06T02:47:32.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50391a36-1cf2-46e9-adae-713810647ccc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23302024-12-06T02:47:32.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50391a36-1cf2-46e9-adae-713810647ccc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23312024-12-06T02:47:33.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bbfb7766-9c7f-4cf1-a3f8-908b3a483d8b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23322024-12-06T02:47:33.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bbfb7766-9c7f-4cf1-a3f8-908b3a483d8b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23332024-12-06T02:47:33.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bbfb7766-9c7f-4cf1-a3f8-908b3a483d8b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23342024-12-06T02:47:34.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 220fa01a-69e9-432e-b33f-cd6079995667 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23352024-12-06T02:47:34.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 220fa01a-69e9-432e-b33f-cd6079995667 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23362024-12-06T02:47:34.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 220fa01a-69e9-432e-b33f-cd6079995667 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23372024-12-06T02:47:35.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1289 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = e26058f5-c8e9-413e-abbd-ed9ce6c8e228 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
23382024-12-06T02:47:35.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8d6a58c-68a3-43f1-835f-a16f814baef3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23392024-12-06T02:47:35.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8d6a58c-68a3-43f1-835f-a16f814baef3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23402024-12-06T02:47:35.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8d6a58c-68a3-43f1-835f-a16f814baef3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23412024-12-06T02:47:36.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 906ac358-1bcc-4ef2-8799-ce15fa39d1c5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23422024-12-06T02:47:36.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 906ac358-1bcc-4ef2-8799-ce15fa39d1c5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23432024-12-06T02:47:36.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 906ac358-1bcc-4ef2-8799-ce15fa39d1c5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23442024-12-06T02:47:37.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 269ebf0c-d870-4306-ae10-b4f98b1ed134 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23452024-12-06T02:47:37.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 269ebf0c-d870-4306-ae10-b4f98b1ed134 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23462024-12-06T02:47:37.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 269ebf0c-d870-4306-ae10-b4f98b1ed134 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23472024-12-06T02:47:38.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4e83a892-1022-46ac-84cc-a3a6524e5a93 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23482024-12-06T02:47:38.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4e83a892-1022-46ac-84cc-a3a6524e5a93 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23492024-12-06T02:47:38.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4e83a892-1022-46ac-84cc-a3a6524e5a93 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23502024-12-06T02:47:39.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7bca3176-5e23-4dfd-9f72-929a4b996a9f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23512024-12-06T02:47:39.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7bca3176-5e23-4dfd-9f72-929a4b996a9f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23522024-12-06T02:47:39.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7bca3176-5e23-4dfd-9f72-929a4b996a9f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23532024-12-06T02:47:40.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
23542024-12-06T02:47:40.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23552024-12-06T02:47:40.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
23562024-12-06T02:47:40.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23572024-12-06T02:47:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23582024-12-06T02:47:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23592024-12-06T02:47:40.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23602024-12-06T02:47:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23612024-12-06T02:47:40.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23622024-12-06T02:47:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23632024-12-06T02:47:40.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23642024-12-06T02:47:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23652024-12-06T02:47:40.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23662024-12-06T02:47:40.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23672024-12-06T02:47:40.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682024-12-06T02:47:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
23692024-12-06T02:47:40.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23702024-12-06T02:47:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23712024-12-06T02:47:40.119ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
23722024-12-06T02:47:40.119ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.340255ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
23732024-12-06T02:47:40.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.157641ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23742024-12-06T02:47:40.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba5f25d3-12f6-46e1-b536-71809853b09f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23752024-12-06T02:47:40.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba5f25d3-12f6-46e1-b536-71809853b09f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23762024-12-06T02:47:40.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba5f25d3-12f6-46e1-b536-71809853b09f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23772024-12-06T02:47:41.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 79a7e961-6103-4bca-a1f6-55ba385092ac roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23782024-12-06T02:47:41.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 79a7e961-6103-4bca-a1f6-55ba385092ac resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23792024-12-06T02:47:41.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 79a7e961-6103-4bca-a1f6-55ba385092ac response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23802024-12-06T02:47:42.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0bcc0bae-7c04-449b-b306-ee7928c149c8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23812024-12-06T02:47:42.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0bcc0bae-7c04-449b-b306-ee7928c149c8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23822024-12-06T02:47:42.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0bcc0bae-7c04-449b-b306-ee7928c149c8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23832024-12-06T02:47:43.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 56f6e431-68f8-441b-a85f-58f37aee901b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23842024-12-06T02:47:43.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 56f6e431-68f8-441b-a85f-58f37aee901b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23852024-12-06T02:47:43.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 56f6e431-68f8-441b-a85f-58f37aee901b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23862024-12-06T02:47:44.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 489365a9-786e-47cf-8e2d-398b7f09493e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23872024-12-06T02:47:44.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 489365a9-786e-47cf-8e2d-398b7f09493e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23882024-12-06T02:47:44.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 489365a9-786e-47cf-8e2d-398b7f09493e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23892024-12-06T02:47:45.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = de43c2ce-b2cb-4017-a060-e37f81e60a6f roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
23902024-12-06T02:47:45.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = de43c2ce-b2cb-4017-a060-e37f81e60a6f resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
23912024-12-06T02:47:45.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = de43c2ce-b2cb-4017-a060-e37f81e60a6f response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
23922024-12-06T02:47:45.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 6d2b4bbd-bb31-4599-9fb8-e6d00f9157cf roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
23932024-12-06T02:47:45.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 6d2b4bbd-bb31-4599-9fb8-e6d00f9157cf resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
23942024-12-06T02:47:45.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 6d2b4bbd-bb31-4599-9fb8-e6d00f9157cf response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
23952024-12-06T02:47:45.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1108 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = a08bf9b7-158c-45dd-9c6e-43b50413534d response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
23962024-12-06T02:47:45.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a3bff430-736f-4627-a430-1fd52fe64125 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23972024-12-06T02:47:45.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a3bff430-736f-4627-a430-1fd52fe64125 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23982024-12-06T02:47:45.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a3bff430-736f-4627-a430-1fd52fe64125 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
23992024-12-06T02:47:46.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c48e09c-fd47-4d12-93d3-50805a1e845b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24002024-12-06T02:47:46.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c48e09c-fd47-4d12-93d3-50805a1e845b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24012024-12-06T02:47:46.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c48e09c-fd47-4d12-93d3-50805a1e845b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24022024-12-06T02:47:47.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f22bb1cd-0938-4779-bdd4-fa411dca2553 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24032024-12-06T02:47:47.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f22bb1cd-0938-4779-bdd4-fa411dca2553 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24042024-12-06T02:47:47.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f22bb1cd-0938-4779-bdd4-fa411dca2553 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24052024-12-06T02:47:48.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fc001224-8b3f-474e-a66c-085b8b5d1afe roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24062024-12-06T02:47:48.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fc001224-8b3f-474e-a66c-085b8b5d1afe resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24072024-12-06T02:47:48.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fc001224-8b3f-474e-a66c-085b8b5d1afe response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24082024-12-06T02:47:49.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 05504e31-264b-45af-9cb4-19a04aeec9a4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24092024-12-06T02:47:49.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 05504e31-264b-45af-9cb4-19a04aeec9a4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24102024-12-06T02:47:49.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 05504e31-264b-45af-9cb4-19a04aeec9a4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24112024-12-06T02:47:50.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
24122024-12-06T02:47:50.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
24132024-12-06T02:47:50.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24142024-12-06T02:47:50.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24152024-12-06T02:47:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24162024-12-06T02:47:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24172024-12-06T02:47:50.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24182024-12-06T02:47:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24192024-12-06T02:47:50.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24202024-12-06T02:47:50.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.885132ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24212024-12-06T02:47:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24222024-12-06T02:47:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24232024-12-06T02:47:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24242024-12-06T02:47:50.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24252024-12-06T02:47:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24262024-12-06T02:47:50.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272024-12-06T02:47:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
24282024-12-06T02:47:50.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24292024-12-06T02:47:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24302024-12-06T02:47:50.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
24312024-12-06T02:47:50.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.04815ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
24322024-12-06T02:47:50.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 377741c2-fa4c-4546-98d7-5ba683d2de71 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24332024-12-06T02:47:50.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 377741c2-fa4c-4546-98d7-5ba683d2de71 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24342024-12-06T02:47:50.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 377741c2-fa4c-4546-98d7-5ba683d2de71 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24352024-12-06T02:47:52.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 94e2f59d-5465-4d1d-99b9-a16702c8fee7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24362024-12-06T02:47:52.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 94e2f59d-5465-4d1d-99b9-a16702c8fee7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24372024-12-06T02:47:52.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 94e2f59d-5465-4d1d-99b9-a16702c8fee7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24382024-12-06T02:47:53.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = efa1b478-f58c-4b68-968f-4e8e69d36f39 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24392024-12-06T02:47:53.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = efa1b478-f58c-4b68-968f-4e8e69d36f39 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24402024-12-06T02:47:53.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = efa1b478-f58c-4b68-968f-4e8e69d36f39 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24412024-12-06T02:47:54.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 209cae46-97ad-4e0b-afe9-d941a9760f8c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24422024-12-06T02:47:54.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 209cae46-97ad-4e0b-afe9-d941a9760f8c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24432024-12-06T02:47:54.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 209cae46-97ad-4e0b-afe9-d941a9760f8c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24442024-12-06T02:47:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1275 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 48971475-4b60-40e3-a737-cc55803ff020 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
24452024-12-06T02:47:55.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 43e17e52-ad97-4266-af0d-56c781fda362 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24462024-12-06T02:47:55.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 43e17e52-ad97-4266-af0d-56c781fda362 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24472024-12-06T02:47:55.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 43e17e52-ad97-4266-af0d-56c781fda362 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24482024-12-06T02:47:56.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e8ae042-4db6-40db-8987-418a5669db07 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24492024-12-06T02:47:56.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e8ae042-4db6-40db-8987-418a5669db07 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24502024-12-06T02:47:56.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e8ae042-4db6-40db-8987-418a5669db07 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24512024-12-06T02:47:57.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae9f83f0-e08c-4300-9e73-d7875fc745a7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24522024-12-06T02:47:57.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae9f83f0-e08c-4300-9e73-d7875fc745a7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24532024-12-06T02:47:57.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae9f83f0-e08c-4300-9e73-d7875fc745a7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24542024-12-06T02:47:58.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed28c0b0-b9f9-4292-b9e1-fbeabdfd0bd7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24552024-12-06T02:47:58.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed28c0b0-b9f9-4292-b9e1-fbeabdfd0bd7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24562024-12-06T02:47:58.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed28c0b0-b9f9-4292-b9e1-fbeabdfd0bd7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24572024-12-06T02:47:59.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d347bb3-c2f6-4c38-841e-f5f73b5d3626 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24582024-12-06T02:47:59.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d347bb3-c2f6-4c38-841e-f5f73b5d3626 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24592024-12-06T02:47:59.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d347bb3-c2f6-4c38-841e-f5f73b5d3626 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
24602024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
24612024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24622024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
24632024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
24642024-12-06T02:48:00.102ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:38:00.102197055 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24652024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24662024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
24672024-12-06T02:48:00.102ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24682024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24692024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
24702024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
24712024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24722024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
24732024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
24742024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24752024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24762024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
24772024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24782024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
24792024-12-06T02:48:00.102ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
24802024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
24812024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.621\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
24822024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
24832024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
24842024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24852024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24862024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
24872024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24882024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24892024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
24902024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24912024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
24922024-12-06T02:48:00.102ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24932024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24942024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
24952024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24962024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
24972024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24982024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
24992024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
25002024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25012024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
25022024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
25032024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
25042024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25052024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25062024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
25072024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
25082024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
25092024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25102024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25112024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
25122024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
25132024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25142024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
25152024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
25162024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25172024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
25182024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
25192024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25202024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25212024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
25222024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25232024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
25242024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
25252024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
25262024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25272024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25282024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25292024-12-06T02:48:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25302024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25312024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25322024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25332024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25342024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25352024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25362024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25372024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25382024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25392024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25402024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25412024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25422024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25432024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25442024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25452024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25462024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25472024-12-06T02:48:00.103ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6028, tv_nsec: 470109135 } })
25482024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
25492024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25502024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25512024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25522024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
25532024-12-06T02:48:00.103ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6028, tv_nsec: 470226828 } })
25542024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25552024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25562024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25572024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25582024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
25592024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.256996ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
25602024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
25612024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.74937ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
25622024-12-06T02:48:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25632024-12-06T02:48:00.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25642024-12-06T02:48:00.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25652024-12-06T02:48:00.106ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:38:00.102197055 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25662024-12-06T02:48:00.106ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.605521ms iteration = 7 status = {"expiration":"2024-12-06T02:38:00.102197055Z","pruned":[]}
25672024-12-06T02:48:00.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682024-12-06T02:48:00.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6028, tv_nsec: 476368634 } })
25692024-12-06T02:48:00.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
25702024-12-06T02:48:00.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25712024-12-06T02:48:00.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25722024-12-06T02:48:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25732024-12-06T02:48:00.113ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.773488ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25742024-12-06T02:48:00.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25752024-12-06T02:48:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25762024-12-06T02:48:00.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25772024-12-06T02:48:00.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25782024-12-06T02:48:00.121ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25792024-12-06T02:48:00.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25802024-12-06T02:48:00.124ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25812024-12-06T02:48:00.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25822024-12-06T02:48:00.127ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25832024-12-06T02:48:00.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25842024-12-06T02:48:00.129ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25852024-12-06T02:48:00.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25862024-12-06T02:48:00.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25872024-12-06T02:48:00.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25882024-12-06T02:48:00.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25892024-12-06T02:48:00.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25902024-12-06T02:48:00.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25912024-12-06T02:48:00.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25922024-12-06T02:48:00.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25932024-12-06T02:48:00.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25942024-12-06T02:48:00.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25952024-12-06T02:48:00.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25962024-12-06T02:48:00.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25972024-12-06T02:48:00.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25982024-12-06T02:48:00.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25992024-12-06T02:48:00.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26002024-12-06T02:48:00.141ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6028, tv_nsec: 508705316 } })
26012024-12-06T02:48:00.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26022024-12-06T02:48:00.142ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
26032024-12-06T02:48:00.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26042024-12-06T02:48:00.166ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26052024-12-06T02:48:00.168ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
26062024-12-06T02:48:00.168ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
26072024-12-06T02:48:00.168ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.222841ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
26082024-12-06T02:48:00.169ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 66.575141ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
26092024-12-06T02:48:00.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
26102024-12-06T02:48:00.169ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
26112024-12-06T02:48:00.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
26122024-12-06T02:48:00.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e8ac1e5f-a569-4345-8417-0a8d5493ef6f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
26132024-12-06T02:48:00.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e8ac1e5f-a569-4345-8417-0a8d5493ef6f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
26142024-12-06T02:48:00.184ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26152024-12-06T02:48:00.184ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.070764ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26162024-12-06T02:48:00.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26172024-12-06T02:48:00.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26182024-12-06T02:48:00.188ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26192024-12-06T02:48:00.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26202024-12-06T02:48:00.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26212024-12-06T02:48:00.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26222024-12-06T02:48:00.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26232024-12-06T02:48:00.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26242024-12-06T02:48:00.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26252024-12-06T02:48:00.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26262024-12-06T02:48:00.211ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26272024-12-06T02:48:00.212ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26282024-12-06T02:48:00.212ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26292024-12-06T02:48:00.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26302024-12-06T02:48:00.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26312024-12-06T02:48:00.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
26322024-12-06T02:48:00.213ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
26332024-12-06T02:48:00.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
26342024-12-06T02:48:00.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-12-06T02:48:00.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26362024-12-06T02:48:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26372024-12-06T02:48:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26382024-12-06T02:48:00.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26392024-12-06T02:48:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26402024-12-06T02:48:00.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 125.891785ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
26412024-12-06T02:48:00.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e8ac1e5f-a569-4345-8417-0a8d5493ef6f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
26422024-12-06T02:48:00.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26432024-12-06T02:48:00.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442024-12-06T02:48:00.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452024-12-06T02:48:00.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462024-12-06T02:48:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
26472024-12-06T02:48:00.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26482024-12-06T02:48:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26492024-12-06T02:48:00.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502024-12-06T02:48:00.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26512024-12-06T02:48:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26522024-12-06T02:48:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26532024-12-06T02:48:00.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26542024-12-06T02:48:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26552024-12-06T02:48:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
26562024-12-06T02:48:00.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
26572024-12-06T02:48:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
26582024-12-06T02:48:00.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26592024-12-06T02:48:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
26602024-12-06T02:48:00.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26612024-12-06T02:48:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26622024-12-06T02:48:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26632024-12-06T02:48:00.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26642024-12-06T02:48:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26652024-12-06T02:48:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
26662024-12-06T02:48:00.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
26672024-12-06T02:48:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 139.384201ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26682024-12-06T02:48:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
26692024-12-06T02:48:00.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702024-12-06T02:48:00.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26712024-12-06T02:48:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26722024-12-06T02:48:00.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
26732024-12-06T02:48:00.244ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
26742024-12-06T02:48:00.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
26752024-12-06T02:48:00.248ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 146.328539ms iteration = 4 status = {"nsuccess":5}
26762024-12-06T02:48:00.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 146.424231ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
26772024-12-06T02:48:00.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6028, tv_nsec: 616533416 } })
26782024-12-06T02:48:00.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
26792024-12-06T02:48:00.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26802024-12-06T02:48:00.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26812024-12-06T02:48:00.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26822024-12-06T02:48:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26832024-12-06T02:48:00.260ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
26842024-12-06T02:48:00.260ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
26852024-12-06T02:48:00.261ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 158.782215ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26862024-12-06T02:48:00.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26872024-12-06T02:48:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26882024-12-06T02:48:00.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
26892024-12-06T02:48:00.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 161.937945ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
26902024-12-06T02:48:00.268ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26912024-12-06T02:48:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26922024-12-06T02:48:00.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26932024-12-06T02:48:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26942024-12-06T02:48:00.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26952024-12-06T02:48:00.281ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
26962024-12-06T02:48:00.281ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26972024-12-06T02:48:00.281ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26982024-12-06T02:48:00.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26992024-12-06T02:48:00.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27002024-12-06T02:48:00.296ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27012024-12-06T02:48:00.296ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27022024-12-06T02:48:00.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27032024-12-06T02:48:00.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27042024-12-06T02:48:00.297ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27052024-12-06T02:48:00.297ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27062024-12-06T02:48:00.297ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27072024-12-06T02:48:00.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27082024-12-06T02:48:00.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27092024-12-06T02:48:00.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 197.785738ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27102024-12-06T02:48:00.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27112024-12-06T02:48:00.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27122024-12-06T02:48:00.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 209.999267ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27132024-12-06T02:48:00.343ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27142024-12-06T02:48:00.343ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27152024-12-06T02:48:00.343ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f651b9e6-432d-4a58-bab2-eb541e463729", "content-length": "26", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
27162024-12-06T02:48:00.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27172024-12-06T02:48:00.346ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27182024-12-06T02:48:00.362ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
27192024-12-06T02:48:00.374ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 271.795882ms iteration = 16 status = {"physical_disks_added":0}
27202024-12-06T02:48:00.377ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27212024-12-06T02:48:00.377ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27222024-12-06T02:48:00.378ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3e06a92-59ef-4328-bc1c-bb79b4864b2b", "content-length": "26", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
27232024-12-06T02:48:00.378ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27242024-12-06T02:48:00.379ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27252024-12-06T02:48:00.383ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
27262024-12-06T02:48:00.383ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 281.054947ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
27272024-12-06T02:48:00.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27282024-12-06T02:48:00.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27292024-12-06T02:48:00.419ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
27302024-12-06T02:48:00.419ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27312024-12-06T02:48:00.419ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8558b6df-b18e-496c-8805-5f15794f1b96", "content-length": "26", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
27322024-12-06T02:48:00.419ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27332024-12-06T02:48:00.421ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
27342024-12-06T02:48:00.440ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
27352024-12-06T02:48:00.540ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27362024-12-06T02:48:00.541ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ac781d-03ac-4653-a3ed-596d244c237a", "content-length": "1", "date": "Fri, 06 Dec 2024 02:47:59 GMT"} })
27372024-12-06T02:48:00.542ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27382024-12-06T02:48:00.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27392024-12-06T02:48:00.548ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27402024-12-06T02:48:00.549ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27412024-12-06T02:48:00.549ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "82b00740-6366-4bb0-b6f4-d9c4042eed61", "content-length": "372", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
27422024-12-06T02:48:00.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27432024-12-06T02:48:00.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27442024-12-06T02:48:00.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452024-12-06T02:48:00.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27462024-12-06T02:48:00.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27472024-12-06T02:48:00.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27482024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27492024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27502024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27512024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
27522024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9a7050af-8c38-40d0-878e-eddb693e46c3", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27532024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27542024-12-06T02:48:00.556ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27552024-12-06T02:48:00.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27562024-12-06T02:48:00.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27572024-12-06T02:48:00.559ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "aa27006f-b601-49a3-9ca3-a29512631ad1", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27582024-12-06T02:48:00.559ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27592024-12-06T02:48:00.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602024-12-06T02:48:00.562ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27612024-12-06T02:48:00.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 459.985938ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27622024-12-06T02:48:00.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27632024-12-06T02:48:00.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27642024-12-06T02:48:00.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27652024-12-06T02:48:00.563ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 461.504551ms iteration = 13 status = null
27662024-12-06T02:48:00.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27672024-12-06T02:48:00.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
27682024-12-06T02:48:00.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27692024-12-06T02:48:00.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27702024-12-06T02:48:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 469.271863ms iteration = 13 status = 0
27712024-12-06T02:48:00.581ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27722024-12-06T02:48:00.582ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "97ecb3c0-3c17-4522-831b-6443cd087656", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27732024-12-06T02:48:00.582ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27742024-12-06T02:48:00.584ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bd23d1d6-5824-4ee1-a651-077d09e4ebc7", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27752024-12-06T02:48:00.584ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27762024-12-06T02:48:00.585ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "90f2c4df-85a1-4281-b36f-bf7ac3b0a722", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27772024-12-06T02:48:00.585ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27782024-12-06T02:48:00.587ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27792024-12-06T02:48:00.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 485.310441ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27802024-12-06T02:48:00.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27812024-12-06T02:48:00.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27822024-12-06T02:48:00.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27832024-12-06T02:48:00.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27842024-12-06T02:48:00.597ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27852024-12-06T02:48:00.597ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27862024-12-06T02:48:00.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27872024-12-06T02:48:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27882024-12-06T02:48:00.597ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 495.496992ms iteration = 13 status = {}
27892024-12-06T02:48:00.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 501.781592ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27902024-12-06T02:48:00.606ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27912024-12-06T02:48:00.606ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27922024-12-06T02:48:00.606ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 503.741758ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27932024-12-06T02:48:00.613ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
27942024-12-06T02:48:00.613ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
27952024-12-06T02:48:00.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27962024-12-06T02:48:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27972024-12-06T02:48:00.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27982024-12-06T02:48:00.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27992024-12-06T02:48:00.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28002024-12-06T02:48:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28012024-12-06T02:48:00.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28022024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
28032024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28042024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
28052024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 517.655585ms iteration = 8 status = {"generation":2}
28062024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28072024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28082024-12-06T02:48:00.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28092024-12-06T02:48:00.629ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28102024-12-06T02:48:00.629ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28112024-12-06T02:48:00.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122024-12-06T02:48:00.645ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
28132024-12-06T02:48:00.645ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 543.561956ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28142024-12-06T02:48:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28152024-12-06T02:48:00.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28162024-12-06T02:48:00.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28172024-12-06T02:48:00.648ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
28182024-12-06T02:48:00.648ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28192024-12-06T02:48:00.648ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
28202024-12-06T02:48:00.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 546.093128ms iteration = 8 status = {"generation":1}
28212024-12-06T02:48:00.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28222024-12-06T02:48:00.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28232024-12-06T02:48:00.655ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
28242024-12-06T02:48:00.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28252024-12-06T02:48:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28262024-12-06T02:48:00.666ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28272024-12-06T02:48:00.666ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "47cbbc05-be7c-43d1-b14b-89e33f514aa5", "content-length": "134", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28282024-12-06T02:48:00.666ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28292024-12-06T02:48:00.666ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
28302024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28312024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28322024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28332024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28342024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28352024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28362024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28372024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28382024-12-06T02:48:00.667ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
28392024-12-06T02:48:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28402024-12-06T02:48:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28412024-12-06T02:48:00.669ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28422024-12-06T02:48:00.669ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "141d420e-cb50-46f3-90ba-b6af33a0d6e7", "content-length": "2", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28432024-12-06T02:48:00.669ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28442024-12-06T02:48:00.669ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c371a11-1ac0-4fd6-a15e-548f3c07dbef", "content-length": "52", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28452024-12-06T02:48:00.669ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
28462024-12-06T02:48:00.669ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28472024-12-06T02:48:00.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "97991096-0c7c-44da-bfe1-e9a5b44a1ca4", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28482024-12-06T02:48:00.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28492024-12-06T02:48:00.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28502024-12-06T02:48:00.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28512024-12-06T02:48:00.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a56895-6393-489d-abbd-915caa093d7c", "content-length": "691", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28522024-12-06T02:48:00.713ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28532024-12-06T02:48:00.713ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28542024-12-06T02:48:00.713ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28552024-12-06T02:48:00.714ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 612.366791ms iteration = 13 status = {}
28562024-12-06T02:48:00.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28572024-12-06T02:48:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28582024-12-06T02:48:00.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28592024-12-06T02:48:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28602024-12-06T02:48:00.721ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28612024-12-06T02:48:00.721ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28622024-12-06T02:48:00.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "27927ef8-67d3-4a3e-aa6c-2e1d6c719e97", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28632024-12-06T02:48:00.724ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 622.185981ms iteration = 14 status = {}
28642024-12-06T02:48:00.791ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d7c0c62d-1624-4f1d-b240-e56484f76e0a", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28652024-12-06T02:48:00.791ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
28662024-12-06T02:48:00.791ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28672024-12-06T02:48:00.794ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "99ad217f-9872-489a-b8e8-60da8a33ef1c", "content-length": "682", "date": "Fri, 06 Dec 2024 02:48:00 GMT"} })
28682024-12-06T02:48:00.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28692024-12-06T02:48:00.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28702024-12-06T02:48:00.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28712024-12-06T02:48:00.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28722024-12-06T02:48:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28732024-12-06T02:48:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28742024-12-06T02:48:00.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28752024-12-06T02:48:00.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28762024-12-06T02:48:00.810ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 708.26897ms iteration = 13 status = {}
28772024-12-06T02:48:01.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3872a607-cc00-41b3-9c7b-d4e8bdcf2682 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28782024-12-06T02:48:01.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3872a607-cc00-41b3-9c7b-d4e8bdcf2682 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28792024-12-06T02:48:01.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3872a607-cc00-41b3-9c7b-d4e8bdcf2682 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28802024-12-06T02:48:01.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 96848fb8-4f1a-455b-9c2d-de77c31357ab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28812024-12-06T02:48:01.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 96848fb8-4f1a-455b-9c2d-de77c31357ab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28822024-12-06T02:48:01.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 96848fb8-4f1a-455b-9c2d-de77c31357ab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28832024-12-06T02:48:02.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 439f26fc-ada0-4020-b66d-9f647c4c3fd9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28842024-12-06T02:48:02.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 439f26fc-ada0-4020-b66d-9f647c4c3fd9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28852024-12-06T02:48:02.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 439f26fc-ada0-4020-b66d-9f647c4c3fd9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28862024-12-06T02:48:03.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3aff409d-f44d-4ba3-a30d-1a8cb0493199 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28872024-12-06T02:48:03.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3aff409d-f44d-4ba3-a30d-1a8cb0493199 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28882024-12-06T02:48:03.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3aff409d-f44d-4ba3-a30d-1a8cb0493199 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28892024-12-06T02:48:04.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae809963-93cc-409e-a059-afef1b66dbbb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28902024-12-06T02:48:04.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae809963-93cc-409e-a059-afef1b66dbbb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28912024-12-06T02:48:04.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae809963-93cc-409e-a059-afef1b66dbbb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28922024-12-06T02:48:05.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1341 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 59c6decf-f04a-42ce-b055-277ddcc77f47 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
28932024-12-06T02:48:05.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1297a4d7-2714-404b-a629-75457f3d5e2e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28942024-12-06T02:48:05.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1297a4d7-2714-404b-a629-75457f3d5e2e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28952024-12-06T02:48:05.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1297a4d7-2714-404b-a629-75457f3d5e2e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28962024-12-06T02:48:06.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1abe43ac-fb23-4556-88aa-53c7c024c5fd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28972024-12-06T02:48:06.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1abe43ac-fb23-4556-88aa-53c7c024c5fd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28982024-12-06T02:48:06.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1abe43ac-fb23-4556-88aa-53c7c024c5fd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
28992024-12-06T02:48:07.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1025b009-9558-451d-a8b2-dfa7d9f400a2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29002024-12-06T02:48:07.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1025b009-9558-451d-a8b2-dfa7d9f400a2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29012024-12-06T02:48:07.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1025b009-9558-451d-a8b2-dfa7d9f400a2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29022024-12-06T02:48:08.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f3649abf-8bdf-44b1-972c-17bc9fb70217 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29032024-12-06T02:48:08.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f3649abf-8bdf-44b1-972c-17bc9fb70217 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29042024-12-06T02:48:08.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f3649abf-8bdf-44b1-972c-17bc9fb70217 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29052024-12-06T02:48:09.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e65f269f-1dfe-4e75-89e6-bd0825a170cc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29062024-12-06T02:48:09.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e65f269f-1dfe-4e75-89e6-bd0825a170cc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29072024-12-06T02:48:09.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e65f269f-1dfe-4e75-89e6-bd0825a170cc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29082024-12-06T02:48:10.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
29092024-12-06T02:48:10.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
29102024-12-06T02:48:10.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29112024-12-06T02:48:10.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29122024-12-06T02:48:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29132024-12-06T02:48:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29142024-12-06T02:48:10.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29152024-12-06T02:48:10.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29162024-12-06T02:48:10.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29172024-12-06T02:48:10.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29182024-12-06T02:48:10.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29192024-12-06T02:48:10.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29202024-12-06T02:48:10.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.978453ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29212024-12-06T02:48:10.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29222024-12-06T02:48:10.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29232024-12-06T02:48:10.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29242024-12-06T02:48:10.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
29252024-12-06T02:48:10.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29262024-12-06T02:48:10.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29272024-12-06T02:48:10.146ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
29282024-12-06T02:48:10.146ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.924981ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
29292024-12-06T02:48:10.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ebecdc1-f10b-4c62-b56c-4fed7fbb7419 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29302024-12-06T02:48:10.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ebecdc1-f10b-4c62-b56c-4fed7fbb7419 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29312024-12-06T02:48:10.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ebecdc1-f10b-4c62-b56c-4fed7fbb7419 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29322024-12-06T02:48:11.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d9547d0-f4f2-44d3-8120-d66c40453d11 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29332024-12-06T02:48:11.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d9547d0-f4f2-44d3-8120-d66c40453d11 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29342024-12-06T02:48:11.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d9547d0-f4f2-44d3-8120-d66c40453d11 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29352024-12-06T02:48:12.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc081e28-4ab9-4caf-9b03-5fdb54ea8c3c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29362024-12-06T02:48:12.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc081e28-4ab9-4caf-9b03-5fdb54ea8c3c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29372024-12-06T02:48:12.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc081e28-4ab9-4caf-9b03-5fdb54ea8c3c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29382024-12-06T02:48:13.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 941e16a2-dd14-4dea-98ce-5fd344e75121 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29392024-12-06T02:48:13.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 941e16a2-dd14-4dea-98ce-5fd344e75121 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29402024-12-06T02:48:13.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 941e16a2-dd14-4dea-98ce-5fd344e75121 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29412024-12-06T02:48:14.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6de36d80-f6a3-43af-9e56-240ffa7c8765 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29422024-12-06T02:48:14.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6de36d80-f6a3-43af-9e56-240ffa7c8765 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29432024-12-06T02:48:14.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6de36d80-f6a3-43af-9e56-240ffa7c8765 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29442024-12-06T02:48:15.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 9c653eb0-accd-4162-8c03-1d1cf45a610e roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
29452024-12-06T02:48:15.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 9c653eb0-accd-4162-8c03-1d1cf45a610e resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
29462024-12-06T02:48:15.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 9c653eb0-accd-4162-8c03-1d1cf45a610e response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
29472024-12-06T02:48:15.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 1edb0455-9a2b-42e3-914c-acf148544e0d roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
29482024-12-06T02:48:15.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 1edb0455-9a2b-42e3-914c-acf148544e0d resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
29492024-12-06T02:48:15.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 1edb0455-9a2b-42e3-914c-acf148544e0d response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
29502024-12-06T02:48:15.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1333 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 5cb50925-d076-4c61-a7a1-b114358162ea response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
29512024-12-06T02:48:15.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ec25391f-ef49-4b9a-a679-26ba66647ce8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29522024-12-06T02:48:15.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ec25391f-ef49-4b9a-a679-26ba66647ce8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29532024-12-06T02:48:15.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ec25391f-ef49-4b9a-a679-26ba66647ce8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29542024-12-06T02:48:16.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 89c0271b-90f9-444a-a19b-7946e4d46a22 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29552024-12-06T02:48:16.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 89c0271b-90f9-444a-a19b-7946e4d46a22 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29562024-12-06T02:48:16.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 89c0271b-90f9-444a-a19b-7946e4d46a22 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29572024-12-06T02:48:17.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2f86286d-640c-4ba8-b174-4e71e5dc76a0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29582024-12-06T02:48:17.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2f86286d-640c-4ba8-b174-4e71e5dc76a0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29592024-12-06T02:48:17.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2f86286d-640c-4ba8-b174-4e71e5dc76a0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29602024-12-06T02:48:18.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f54c493f-083d-4131-be08-924ccb3b84a4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29612024-12-06T02:48:18.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f54c493f-083d-4131-be08-924ccb3b84a4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29622024-12-06T02:48:18.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f54c493f-083d-4131-be08-924ccb3b84a4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29632024-12-06T02:48:19.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5923f25c-9c93-483d-8c85-e020e00ae1a9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29642024-12-06T02:48:19.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5923f25c-9c93-483d-8c85-e020e00ae1a9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29652024-12-06T02:48:19.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5923f25c-9c93-483d-8c85-e020e00ae1a9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29662024-12-06T02:48:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
29672024-12-06T02:48:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
29682024-12-06T02:48:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29692024-12-06T02:48:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29702024-12-06T02:48:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29712024-12-06T02:48:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29722024-12-06T02:48:20.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29732024-12-06T02:48:20.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29742024-12-06T02:48:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29752024-12-06T02:48:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29762024-12-06T02:48:20.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29772024-12-06T02:48:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29782024-12-06T02:48:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29792024-12-06T02:48:20.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29802024-12-06T02:48:20.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29812024-12-06T02:48:20.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
29822024-12-06T02:48:20.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29832024-12-06T02:48:20.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29842024-12-06T02:48:20.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
29852024-12-06T02:48:20.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.014808ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
29862024-12-06T02:48:20.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.988933ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29872024-12-06T02:48:20.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c861a020-ed1c-44d6-9a20-eec3cec93908 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29882024-12-06T02:48:20.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c861a020-ed1c-44d6-9a20-eec3cec93908 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29892024-12-06T02:48:20.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c861a020-ed1c-44d6-9a20-eec3cec93908 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29902024-12-06T02:48:21.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eb202a7d-68d4-42fa-96c2-7ed234bdca06 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29912024-12-06T02:48:21.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eb202a7d-68d4-42fa-96c2-7ed234bdca06 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29922024-12-06T02:48:21.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eb202a7d-68d4-42fa-96c2-7ed234bdca06 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29932024-12-06T02:48:22.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a76feea8-5526-4599-b559-7be0ab07e1fa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29942024-12-06T02:48:22.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a76feea8-5526-4599-b559-7be0ab07e1fa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29952024-12-06T02:48:22.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a76feea8-5526-4599-b559-7be0ab07e1fa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29962024-12-06T02:48:23.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2a205b2d-b46c-4c5d-a4a2-c81a6c65e516 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29972024-12-06T02:48:23.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2a205b2d-b46c-4c5d-a4a2-c81a6c65e516 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29982024-12-06T02:48:23.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2a205b2d-b46c-4c5d-a4a2-c81a6c65e516 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
29992024-12-06T02:48:24.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a71bfae6-88d0-44df-8383-e3e840e16984 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30002024-12-06T02:48:24.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a71bfae6-88d0-44df-8383-e3e840e16984 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30012024-12-06T02:48:24.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a71bfae6-88d0-44df-8383-e3e840e16984 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30022024-12-06T02:48:25.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1239 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 5844bb33-dbcb-4d47-8075-2e78b9a8b507 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
30032024-12-06T02:48:25.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 74e2b963-e12d-483a-a504-7461cbb4ba19 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30042024-12-06T02:48:25.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 74e2b963-e12d-483a-a504-7461cbb4ba19 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30052024-12-06T02:48:25.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 74e2b963-e12d-483a-a504-7461cbb4ba19 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30062024-12-06T02:48:26.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed8f49ad-f8ec-4202-9ec8-194d6dc79bed roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30072024-12-06T02:48:26.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed8f49ad-f8ec-4202-9ec8-194d6dc79bed resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30082024-12-06T02:48:26.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed8f49ad-f8ec-4202-9ec8-194d6dc79bed response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30092024-12-06T02:48:27.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9955cfba-40be-4317-babb-66df0538388c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30102024-12-06T02:48:27.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9955cfba-40be-4317-babb-66df0538388c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30112024-12-06T02:48:27.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9955cfba-40be-4317-babb-66df0538388c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30122024-12-06T02:48:28.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e14bc081-cfb9-48c9-afae-9c601751aedc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30132024-12-06T02:48:28.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e14bc081-cfb9-48c9-afae-9c601751aedc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30142024-12-06T02:48:28.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e14bc081-cfb9-48c9-afae-9c601751aedc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30152024-12-06T02:48:29.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7af8e4d-b438-40a7-85b4-8dce4bb002f6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30162024-12-06T02:48:29.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7af8e4d-b438-40a7-85b4-8dce4bb002f6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30172024-12-06T02:48:29.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7af8e4d-b438-40a7-85b4-8dce4bb002f6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
30182024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
30192024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
30202024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30212024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30222024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
30232024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30242024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
30252024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
30262024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30272024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30282024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
30292024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30302024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
30312024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30322024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
30332024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
30342024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
30352024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
30362024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30372024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
30382024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30392024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30402024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30412024-12-06T02:48:30.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30422024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
30432024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30442024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30452024-12-06T02:48:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30462024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30472024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30482024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30492024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30502024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30512024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30522024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30532024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30542024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30552024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30562024-12-06T02:48:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30572024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
30582024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
30592024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30602024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30612024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
30622024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30632024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30642024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
30652024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30662024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30672024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30682024-12-06T02:48:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30692024-12-06T02:48:30.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30702024-12-06T02:48:30.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30712024-12-06T02:48:30.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30722024-12-06T02:48:30.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30732024-12-06T02:48:30.117ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 16.727517ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30742024-12-06T02:48:30.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6058, tv_nsec: 485507134 } })
30752024-12-06T02:48:30.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6058, tv_nsec: 485567035 } })
30762024-12-06T02:48:30.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
30772024-12-06T02:48:30.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
30782024-12-06T02:48:30.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30792024-12-06T02:48:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30802024-12-06T02:48:30.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30812024-12-06T02:48:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30822024-12-06T02:48:30.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832024-12-06T02:48:30.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30842024-12-06T02:48:30.130ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30852024-12-06T02:48:30.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30862024-12-06T02:48:30.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30872024-12-06T02:48:30.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30882024-12-06T02:48:30.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30892024-12-06T02:48:30.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30902024-12-06T02:48:30.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 32.060136ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
30912024-12-06T02:48:30.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30922024-12-06T02:48:30.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30932024-12-06T02:48:30.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30942024-12-06T02:48:30.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30952024-12-06T02:48:30.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30962024-12-06T02:48:30.178ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30972024-12-06T02:48:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30982024-12-06T02:48:30.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30992024-12-06T02:48:30.179ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31002024-12-06T02:48:30.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31012024-12-06T02:48:30.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31022024-12-06T02:48:30.179ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31032024-12-06T02:48:30.180ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75a8ea16-7e24-4c49-b4e4-9362ef43695b", "content-length": "26", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
31042024-12-06T02:48:30.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31052024-12-06T02:48:30.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31062024-12-06T02:48:30.189ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31072024-12-06T02:48:30.189ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31082024-12-06T02:48:30.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31092024-12-06T02:48:30.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31102024-12-06T02:48:30.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-12-06T02:48:30.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31122024-12-06T02:48:30.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31132024-12-06T02:48:30.191ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31142024-12-06T02:48:30.191ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31152024-12-06T02:48:30.192ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fba86ff-736e-4727-948a-2a1112aab445", "content-length": "26", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
31162024-12-06T02:48:30.192ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31172024-12-06T02:48:30.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31182024-12-06T02:48:30.193ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31192024-12-06T02:48:30.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31202024-12-06T02:48:30.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31212024-12-06T02:48:30.195ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31222024-12-06T02:48:30.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
31232024-12-06T02:48:30.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31242024-12-06T02:48:30.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31252024-12-06T02:48:30.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262024-12-06T02:48:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31272024-12-06T02:48:30.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31282024-12-06T02:48:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31292024-12-06T02:48:30.198ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31302024-12-06T02:48:30.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31312024-12-06T02:48:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31322024-12-06T02:48:30.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31332024-12-06T02:48:30.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31342024-12-06T02:48:30.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31352024-12-06T02:48:30.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.277312ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
31362024-12-06T02:48:30.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31372024-12-06T02:48:30.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31382024-12-06T02:48:30.205ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31392024-12-06T02:48:30.205ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.565327ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31402024-12-06T02:48:30.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31412024-12-06T02:48:30.212ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31422024-12-06T02:48:30.214ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6058, tv_nsec: 581790664 } })
31432024-12-06T02:48:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31442024-12-06T02:48:30.214ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
31452024-12-06T02:48:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31462024-12-06T02:48:30.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31472024-12-06T02:48:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31482024-12-06T02:48:30.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.109088ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31492024-12-06T02:48:30.220ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
31502024-12-06T02:48:30.220ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.7462ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
31512024-12-06T02:48:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.469609ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31522024-12-06T02:48:30.236ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31532024-12-06T02:48:30.236ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31542024-12-06T02:48:30.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31552024-12-06T02:48:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31562024-12-06T02:48:30.239ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31572024-12-06T02:48:30.239ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31582024-12-06T02:48:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.723112ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31592024-12-06T02:48:30.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31602024-12-06T02:48:30.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31612024-12-06T02:48:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31622024-12-06T02:48:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
31632024-12-06T02:48:30.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31642024-12-06T02:48:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31652024-12-06T02:48:30.246ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.699191ms iteration = 14 status = 0
31662024-12-06T02:48:30.249ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 148.827971ms iteration = 14 status = {}
31672024-12-06T02:48:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 149.812219ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31682024-12-06T02:48:30.259ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31692024-12-06T02:48:30.259ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7301936-107f-4777-99a9-7073374cc95f", "content-length": "1", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
31702024-12-06T02:48:30.261ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31712024-12-06T02:48:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31722024-12-06T02:48:30.264ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 164.283862ms iteration = 14 status = null
31732024-12-06T02:48:30.269ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
31742024-12-06T02:48:30.269ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31752024-12-06T02:48:30.269ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ddc4a20-c361-4e4a-9417-3d1d69522d6b", "content-length": "26", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
31762024-12-06T02:48:30.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31772024-12-06T02:48:30.271ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
31782024-12-06T02:48:30.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 183.387468ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31792024-12-06T02:48:30.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31802024-12-06T02:48:30.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31812024-12-06T02:48:30.340ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31822024-12-06T02:48:30.340ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31832024-12-06T02:48:30.341ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "85d9af10-01b3-4b84-82ad-8a7db22d15e8", "content-length": "372", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
31842024-12-06T02:48:30.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31852024-12-06T02:48:30.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31862024-12-06T02:48:30.343ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.96568ms iteration = 17 status = {"physical_disks_added":0}
31872024-12-06T02:48:30.381ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31882024-12-06T02:48:30.381ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31892024-12-06T02:48:30.381ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "49a3e733-400e-4914-a6a5-9d001d7c54a9", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
31902024-12-06T02:48:30.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31912024-12-06T02:48:30.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31922024-12-06T02:48:30.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31932024-12-06T02:48:30.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31942024-12-06T02:48:30.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31952024-12-06T02:48:30.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31962024-12-06T02:48:30.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31972024-12-06T02:48:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31982024-12-06T02:48:30.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31992024-12-06T02:48:30.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32002024-12-06T02:48:30.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32012024-12-06T02:48:30.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32022024-12-06T02:48:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32032024-12-06T02:48:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32042024-12-06T02:48:30.390ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32052024-12-06T02:48:30.390ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32062024-12-06T02:48:30.391ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "483e2ece-add8-4523-bbee-2a5d2c7810e8", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32072024-12-06T02:48:30.395ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 294.362008ms iteration = 15 status = {}
32082024-12-06T02:48:30.395ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
32092024-12-06T02:48:30.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32102024-12-06T02:48:30.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32112024-12-06T02:48:30.405ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32122024-12-06T02:48:30.405ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b15101b7-588b-43ca-b3ee-2f2db7f69abb", "content-length": "134", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32132024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32142024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
32152024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32162024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32172024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32182024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32192024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32202024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32212024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32222024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32232024-12-06T02:48:30.405ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
32242024-12-06T02:48:30.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32252024-12-06T02:48:30.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32262024-12-06T02:48:30.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32272024-12-06T02:48:30.408ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc25b02e-0258-49fd-bde7-e21e69e81fe9", "content-length": "2", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32282024-12-06T02:48:30.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32292024-12-06T02:48:30.408ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7109000-5790-4951-ab01-fc2a73628917", "content-length": "52", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32302024-12-06T02:48:30.408ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
32312024-12-06T02:48:30.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32322024-12-06T02:48:30.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332024-12-06T02:48:30.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32342024-12-06T02:48:30.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32352024-12-06T02:48:30.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32362024-12-06T02:48:30.513ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8518a8bd-68c5-4df6-852d-25335a615ba0", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32372024-12-06T02:48:30.513ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
32382024-12-06T02:48:30.513ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32392024-12-06T02:48:30.513ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a049f650-caef-4575-8f1d-69e3f28fa212", "content-length": "682", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32402024-12-06T02:48:30.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32412024-12-06T02:48:30.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32422024-12-06T02:48:30.517ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32432024-12-06T02:48:30.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32442024-12-06T02:48:30.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32452024-12-06T02:48:30.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bcadea8-dcd7-4bc6-a04c-d1669a9ce1a4", "content-length": "691", "date": "Fri, 06 Dec 2024 02:48:30 GMT"} })
32462024-12-06T02:48:30.519ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32472024-12-06T02:48:30.519ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32482024-12-06T02:48:30.519ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32492024-12-06T02:48:30.520ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.441049ms iteration = 14 status = {}
32502024-12-06T02:48:30.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32512024-12-06T02:48:30.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32522024-12-06T02:48:30.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32532024-12-06T02:48:30.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32542024-12-06T02:48:30.534ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.932634ms iteration = 14 status = {}
32552024-12-06T02:48:30.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1b722c2f-8202-410d-9621-ee31a778e2f6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32562024-12-06T02:48:30.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1b722c2f-8202-410d-9621-ee31a778e2f6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32572024-12-06T02:48:30.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1b722c2f-8202-410d-9621-ee31a778e2f6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32582024-12-06T02:48:31.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 39cde976-535d-42ea-aafa-644d600bb36b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32592024-12-06T02:48:31.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 39cde976-535d-42ea-aafa-644d600bb36b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32602024-12-06T02:48:31.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 39cde976-535d-42ea-aafa-644d600bb36b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32612024-12-06T02:48:31.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bcbbc2e2-c397-46ad-b913-772c58f38ff3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32622024-12-06T02:48:31.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bcbbc2e2-c397-46ad-b913-772c58f38ff3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32632024-12-06T02:48:31.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bcbbc2e2-c397-46ad-b913-772c58f38ff3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32642024-12-06T02:48:32.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 80e73903-2a8d-482d-9f1c-24784540ab28 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32652024-12-06T02:48:32.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 80e73903-2a8d-482d-9f1c-24784540ab28 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32662024-12-06T02:48:32.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 80e73903-2a8d-482d-9f1c-24784540ab28 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32672024-12-06T02:48:33.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c8369e2-3a46-4291-ad73-9373c78247a2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32682024-12-06T02:48:33.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c8369e2-3a46-4291-ad73-9373c78247a2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32692024-12-06T02:48:33.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c8369e2-3a46-4291-ad73-9373c78247a2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32702024-12-06T02:48:34.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 584e4fb0-fe73-48c4-accb-8235e47188d2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32712024-12-06T02:48:34.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 584e4fb0-fe73-48c4-accb-8235e47188d2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32722024-12-06T02:48:34.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 584e4fb0-fe73-48c4-accb-8235e47188d2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32732024-12-06T02:48:35.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1355 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 0151f3db-0107-494f-8132-0388e4056c4d response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
32742024-12-06T02:48:35.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afc2bb43-a0ff-499e-8458-cf8b3acf0dcf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32752024-12-06T02:48:35.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afc2bb43-a0ff-499e-8458-cf8b3acf0dcf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32762024-12-06T02:48:35.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afc2bb43-a0ff-499e-8458-cf8b3acf0dcf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32772024-12-06T02:48:36.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e4aa4ee6-fdd3-4738-bac5-bae0e7302ba6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32782024-12-06T02:48:36.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e4aa4ee6-fdd3-4738-bac5-bae0e7302ba6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32792024-12-06T02:48:36.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e4aa4ee6-fdd3-4738-bac5-bae0e7302ba6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32802024-12-06T02:48:38.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 70b9ed13-beba-47ac-83e1-aa74b2b77ceb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32812024-12-06T02:48:38.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 70b9ed13-beba-47ac-83e1-aa74b2b77ceb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32822024-12-06T02:48:38.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 70b9ed13-beba-47ac-83e1-aa74b2b77ceb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32832024-12-06T02:48:39.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2a5ca409-1bbe-4515-88f5-87ba64c98b86 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32842024-12-06T02:48:39.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2a5ca409-1bbe-4515-88f5-87ba64c98b86 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32852024-12-06T02:48:39.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2a5ca409-1bbe-4515-88f5-87ba64c98b86 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32862024-12-06T02:48:40.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f8985669-dc2b-4fcd-a329-6f122303ecf0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32872024-12-06T02:48:40.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f8985669-dc2b-4fcd-a329-6f122303ecf0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32882024-12-06T02:48:40.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f8985669-dc2b-4fcd-a329-6f122303ecf0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
32892024-12-06T02:48:40.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
32902024-12-06T02:48:40.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
32912024-12-06T02:48:40.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32922024-12-06T02:48:40.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32932024-12-06T02:48:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32942024-12-06T02:48:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32952024-12-06T02:48:40.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32962024-12-06T02:48:40.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32972024-12-06T02:48:40.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32982024-12-06T02:48:40.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32992024-12-06T02:48:40.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33002024-12-06T02:48:40.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33012024-12-06T02:48:40.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33022024-12-06T02:48:40.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33032024-12-06T02:48:40.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33042024-12-06T02:48:40.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
33052024-12-06T02:48:40.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33062024-12-06T02:48:40.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33072024-12-06T02:48:40.124ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
33082024-12-06T02:48:40.124ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.443898ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
33092024-12-06T02:48:40.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.539417ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33102024-12-06T02:48:41.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fbf3fc33-f2bc-4ff0-8be2-096c4329109f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33112024-12-06T02:48:41.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fbf3fc33-f2bc-4ff0-8be2-096c4329109f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33122024-12-06T02:48:41.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fbf3fc33-f2bc-4ff0-8be2-096c4329109f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33132024-12-06T02:48:42.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 054c8402-ea47-4101-9db4-cbf6f7f63bb2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33142024-12-06T02:48:42.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 054c8402-ea47-4101-9db4-cbf6f7f63bb2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33152024-12-06T02:48:42.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 054c8402-ea47-4101-9db4-cbf6f7f63bb2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33162024-12-06T02:48:43.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 181d2227-3bd3-4777-a770-1ea04c33e604 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33172024-12-06T02:48:43.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 181d2227-3bd3-4777-a770-1ea04c33e604 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33182024-12-06T02:48:43.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 181d2227-3bd3-4777-a770-1ea04c33e604 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33192024-12-06T02:48:44.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53d0ed3c-c5de-4a8b-9b27-7f784e7cef33 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33202024-12-06T02:48:44.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53d0ed3c-c5de-4a8b-9b27-7f784e7cef33 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33212024-12-06T02:48:44.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53d0ed3c-c5de-4a8b-9b27-7f784e7cef33 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33222024-12-06T02:48:45.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1204 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 1626d50c-463b-44bf-ad68-8e996c5f8e7d response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
33232024-12-06T02:48:45.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 96dce2bf-6e3e-4079-996b-c92c3d312390 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33242024-12-06T02:48:45.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 96dce2bf-6e3e-4079-996b-c92c3d312390 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33252024-12-06T02:48:45.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 96dce2bf-6e3e-4079-996b-c92c3d312390 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33262024-12-06T02:48:46.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b1993fe-a9cb-4768-8da3-dd6dd3895926 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33272024-12-06T02:48:46.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b1993fe-a9cb-4768-8da3-dd6dd3895926 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33282024-12-06T02:48:46.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b1993fe-a9cb-4768-8da3-dd6dd3895926 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33292024-12-06T02:48:47.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90f301b6-637c-43d0-91df-d1b08c9d1362 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33302024-12-06T02:48:47.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90f301b6-637c-43d0-91df-d1b08c9d1362 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33312024-12-06T02:48:47.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90f301b6-637c-43d0-91df-d1b08c9d1362 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33322024-12-06T02:48:48.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ca3d10fc-a3eb-411c-8648-be54a542351e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33332024-12-06T02:48:48.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ca3d10fc-a3eb-411c-8648-be54a542351e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33342024-12-06T02:48:48.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ca3d10fc-a3eb-411c-8648-be54a542351e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33352024-12-06T02:48:49.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1752fe28-0d37-4a81-93fc-b869fab23bf6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33362024-12-06T02:48:49.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1752fe28-0d37-4a81-93fc-b869fab23bf6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33372024-12-06T02:48:49.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1752fe28-0d37-4a81-93fc-b869fab23bf6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33382024-12-06T02:48:50.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
33392024-12-06T02:48:50.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33402024-12-06T02:48:50.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
33412024-12-06T02:48:50.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33422024-12-06T02:48:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33432024-12-06T02:48:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33442024-12-06T02:48:50.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33452024-12-06T02:48:50.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33462024-12-06T02:48:50.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33472024-12-06T02:48:50.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.770798ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33482024-12-06T02:48:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33492024-12-06T02:48:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33502024-12-06T02:48:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33512024-12-06T02:48:50.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33522024-12-06T02:48:50.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33532024-12-06T02:48:50.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-12-06T02:48:50.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
33552024-12-06T02:48:50.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33562024-12-06T02:48:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33572024-12-06T02:48:50.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
33582024-12-06T02:48:50.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.05905ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
33592024-12-06T02:48:50.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 73cd5ca5-028c-49b9-9170-4a93d9d0bb01 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33602024-12-06T02:48:50.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 73cd5ca5-028c-49b9-9170-4a93d9d0bb01 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33612024-12-06T02:48:50.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 73cd5ca5-028c-49b9-9170-4a93d9d0bb01 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33622024-12-06T02:48:51.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cb0d218b-fdf4-427a-bac0-694874c8cc34 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33632024-12-06T02:48:51.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cb0d218b-fdf4-427a-bac0-694874c8cc34 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33642024-12-06T02:48:51.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cb0d218b-fdf4-427a-bac0-694874c8cc34 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33652024-12-06T02:48:52.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41b1a48c-ff65-42e5-8552-58cf6c785577 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33662024-12-06T02:48:52.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41b1a48c-ff65-42e5-8552-58cf6c785577 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33672024-12-06T02:48:52.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41b1a48c-ff65-42e5-8552-58cf6c785577 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33682024-12-06T02:48:53.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 626c4315-c6d7-4806-bc55-1b3a08662d30 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33692024-12-06T02:48:53.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 626c4315-c6d7-4806-bc55-1b3a08662d30 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33702024-12-06T02:48:53.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 626c4315-c6d7-4806-bc55-1b3a08662d30 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33712024-12-06T02:48:54.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 493159a4-cdb0-4574-a3cc-d02d0b350e56 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33722024-12-06T02:48:54.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 493159a4-cdb0-4574-a3cc-d02d0b350e56 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33732024-12-06T02:48:54.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 493159a4-cdb0-4574-a3cc-d02d0b350e56 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33742024-12-06T02:48:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1356 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = ddf98cfa-9159-4a14-9ac0-86414871e3e8 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
33752024-12-06T02:48:55.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2d79e2ea-832a-40cd-b26e-4d648c62e0c1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33762024-12-06T02:48:55.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2d79e2ea-832a-40cd-b26e-4d648c62e0c1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33772024-12-06T02:48:55.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2d79e2ea-832a-40cd-b26e-4d648c62e0c1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33782024-12-06T02:48:56.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d1ddebaa-4bac-43ef-a343-e715587cfffa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33792024-12-06T02:48:56.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d1ddebaa-4bac-43ef-a343-e715587cfffa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33802024-12-06T02:48:56.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d1ddebaa-4bac-43ef-a343-e715587cfffa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33812024-12-06T02:48:57.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 454e3066-2d6a-4d8a-8296-218f93cfdb67 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33822024-12-06T02:48:57.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 454e3066-2d6a-4d8a-8296-218f93cfdb67 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33832024-12-06T02:48:57.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 454e3066-2d6a-4d8a-8296-218f93cfdb67 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33842024-12-06T02:48:58.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5f99e246-37d9-426f-b56d-4a2f6b5cd91f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33852024-12-06T02:48:58.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5f99e246-37d9-426f-b56d-4a2f6b5cd91f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33862024-12-06T02:48:58.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5f99e246-37d9-426f-b56d-4a2f6b5cd91f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33872024-12-06T02:48:59.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aa60cdf1-d97b-4621-8227-5ea752f7ae7b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33882024-12-06T02:48:59.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aa60cdf1-d97b-4621-8227-5ea752f7ae7b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33892024-12-06T02:48:59.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aa60cdf1-d97b-4621-8227-5ea752f7ae7b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
33902024-12-06T02:49:00.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 9517dc35-6443-43bf-b3a9-822ea19487ff roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
33912024-12-06T02:49:00.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 9517dc35-6443-43bf-b3a9-822ea19487ff resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
33922024-12-06T02:49:00.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 9517dc35-6443-43bf-b3a9-822ea19487ff response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
33932024-12-06T02:49:00.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = a7034241-a3b3-4742-bf6f-7c9b873fc064 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
33942024-12-06T02:49:00.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = a7034241-a3b3-4742-bf6f-7c9b873fc064 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
33952024-12-06T02:49:00.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = a7034241-a3b3-4742-bf6f-7c9b873fc064 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
33962024-12-06T02:49:00.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
33972024-12-06T02:49:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
33982024-12-06T02:49:00.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33992024-12-06T02:49:00.100ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
34002024-12-06T02:49:00.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34012024-12-06T02:49:00.100ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
34022024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
34032024-12-06T02:49:00.101ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:39:00.100918800 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34042024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34052024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
34062024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
34072024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
34082024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34092024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34102024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34112024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
34122024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34132024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
34142024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34152024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
34162024-12-06T02:49:00.101ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
34172024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
34182024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34192024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
34202024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34212024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34222024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
34232024-12-06T02:49:00.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34242024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34252024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
34262024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
34272024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34282024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34292024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
34302024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
34312024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
34322024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34332024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
34342024-12-06T02:49:00.101ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
34352024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
34362024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.32\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
34372024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
34382024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34392024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
34402024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
34412024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34422024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34432024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
34442024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34452024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
34462024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34472024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34482024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34492024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
34502024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
34512024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
34522024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34532024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34542024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34552024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
34562024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34572024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
34582024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34592024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34602024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34612024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34622024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34632024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34642024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34652024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34662024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34672024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34682024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34692024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34702024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34712024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34722024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34732024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34742024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34752024-12-06T02:49:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34762024-12-06T02:49:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34772024-12-06T02:49:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34782024-12-06T02:49:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34792024-12-06T02:49:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34802024-12-06T02:49:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6088, tv_nsec: 469787072 } })
34812024-12-06T02:49:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6088, tv_nsec: 469845743 } })
34822024-12-06T02:49:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
34832024-12-06T02:49:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.327818ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
34842024-12-06T02:49:00.103ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
34852024-12-06T02:49:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.471192ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
34862024-12-06T02:49:00.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34872024-12-06T02:49:00.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34882024-12-06T02:49:00.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34892024-12-06T02:49:00.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34902024-12-06T02:49:00.111ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34912024-12-06T02:49:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34922024-12-06T02:49:00.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932024-12-06T02:49:00.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34942024-12-06T02:49:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34952024-12-06T02:49:00.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34962024-12-06T02:49:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34972024-12-06T02:49:00.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34982024-12-06T02:49:00.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34992024-12-06T02:49:00.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35002024-12-06T02:49:00.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35012024-12-06T02:49:00.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35022024-12-06T02:49:00.118ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 17.788968ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35032024-12-06T02:49:00.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6088, tv_nsec: 491397629 } })
35042024-12-06T02:49:00.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35052024-12-06T02:49:00.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
35062024-12-06T02:49:00.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35072024-12-06T02:49:00.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35082024-12-06T02:49:00.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35092024-12-06T02:49:00.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35102024-12-06T02:49:00.126ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:39:00.100918800 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35112024-12-06T02:49:00.126ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.968962ms iteration = 8 status = {"expiration":"2024-12-06T02:39:00.100918800Z","pruned":[]}
35122024-12-06T02:49:00.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35132024-12-06T02:49:00.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35142024-12-06T02:49:00.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35152024-12-06T02:49:00.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 27.64595ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
35162024-12-06T02:49:00.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35172024-12-06T02:49:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35182024-12-06T02:49:00.151ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6088, tv_nsec: 519139421 } })
35192024-12-06T02:49:00.151ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
35202024-12-06T02:49:00.153ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35212024-12-06T02:49:00.153ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35222024-12-06T02:49:00.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35232024-12-06T02:49:00.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35242024-12-06T02:49:00.156ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 54.659461ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
35252024-12-06T02:49:00.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35262024-12-06T02:49:00.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35272024-12-06T02:49:00.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35282024-12-06T02:49:00.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35292024-12-06T02:49:00.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35302024-12-06T02:49:00.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35312024-12-06T02:49:00.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35322024-12-06T02:49:00.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35332024-12-06T02:49:00.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35342024-12-06T02:49:00.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35352024-12-06T02:49:00.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35362024-12-06T02:49:00.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35372024-12-06T02:49:00.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35382024-12-06T02:49:00.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35392024-12-06T02:49:00.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35402024-12-06T02:49:00.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35412024-12-06T02:49:00.166ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35422024-12-06T02:49:00.166ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35432024-12-06T02:49:00.166ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35442024-12-06T02:49:00.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35452024-12-06T02:49:00.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35462024-12-06T02:49:00.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472024-12-06T02:49:00.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-12-06T02:49:00.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35492024-12-06T02:49:00.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
35502024-12-06T02:49:00.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35512024-12-06T02:49:00.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35522024-12-06T02:49:00.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35532024-12-06T02:49:00.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35542024-12-06T02:49:00.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35552024-12-06T02:49:00.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35562024-12-06T02:49:00.202ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572024-12-06T02:49:00.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
35582024-12-06T02:49:00.206ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35592024-12-06T02:49:00.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35602024-12-06T02:49:00.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35612024-12-06T02:49:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35622024-12-06T02:49:00.226ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
35632024-12-06T02:49:00.226ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.401311ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
35642024-12-06T02:49:00.226ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652024-12-06T02:49:00.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35662024-12-06T02:49:00.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35672024-12-06T02:49:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35682024-12-06T02:49:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35692024-12-06T02:49:00.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35702024-12-06T02:49:00.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35712024-12-06T02:49:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35722024-12-06T02:49:00.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35732024-12-06T02:49:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35742024-12-06T02:49:00.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-12-06T02:49:00.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35762024-12-06T02:49:00.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35772024-12-06T02:49:00.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35782024-12-06T02:49:00.252ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35792024-12-06T02:49:00.252ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35802024-12-06T02:49:00.252ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 151.186658ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35812024-12-06T02:49:00.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35822024-12-06T02:49:00.256ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35832024-12-06T02:49:00.256ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6088, tv_nsec: 624413538 } })
35842024-12-06T02:49:00.257ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
35852024-12-06T02:49:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35862024-12-06T02:49:00.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35872024-12-06T02:49:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35882024-12-06T02:49:00.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35892024-12-06T02:49:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35902024-12-06T02:49:00.264ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35912024-12-06T02:49:00.264ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35922024-12-06T02:49:00.264ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35932024-12-06T02:49:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35942024-12-06T02:49:00.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35952024-12-06T02:49:00.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 165.246029ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35962024-12-06T02:49:00.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35972024-12-06T02:49:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35982024-12-06T02:49:00.268ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35992024-12-06T02:49:00.268ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 167.290859ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36002024-12-06T02:49:00.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 167.110593ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
36012024-12-06T02:49:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36022024-12-06T02:49:00.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36032024-12-06T02:49:00.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36042024-12-06T02:49:00.272ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36052024-12-06T02:49:00.272ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36062024-12-06T02:49:00.272ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36072024-12-06T02:49:00.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36082024-12-06T02:49:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36092024-12-06T02:49:00.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102024-12-06T02:49:00.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36112024-12-06T02:49:00.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36122024-12-06T02:49:00.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36132024-12-06T02:49:00.285ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36142024-12-06T02:49:00.285ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36152024-12-06T02:49:00.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36162024-12-06T02:49:00.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36172024-12-06T02:49:00.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36182024-12-06T02:49:00.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36192024-12-06T02:49:00.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36202024-12-06T02:49:00.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36212024-12-06T02:49:00.296ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36222024-12-06T02:49:00.296ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36232024-12-06T02:49:00.296ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
36242024-12-06T02:49:00.296ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 194.896117ms iteration = 9 status = {"generation":1}
36252024-12-06T02:49:00.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 199.121037ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36262024-12-06T02:49:00.301ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36272024-12-06T02:49:00.301ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
36282024-12-06T02:49:00.301ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 200.802515ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36292024-12-06T02:49:00.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36302024-12-06T02:49:00.313ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36312024-12-06T02:49:00.314ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36322024-12-06T02:49:00.314ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36332024-12-06T02:49:00.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36342024-12-06T02:49:00.314ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84228c77-f3c8-4454-8d3c-f0163b92ad3f", "content-length": "26", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
36352024-12-06T02:49:00.314ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36362024-12-06T02:49:00.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 216.048661ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36372024-12-06T02:49:00.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 219.85177ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36382024-12-06T02:49:00.326ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36392024-12-06T02:49:00.326ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36402024-12-06T02:49:00.326ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 225.414179ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36412024-12-06T02:49:00.327ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36422024-12-06T02:49:00.333ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36432024-12-06T02:49:00.333ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
36442024-12-06T02:49:00.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36452024-12-06T02:49:00.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36462024-12-06T02:49:00.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36472024-12-06T02:49:00.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36482024-12-06T02:49:00.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36492024-12-06T02:49:00.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502024-12-06T02:49:00.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
36512024-12-06T02:49:00.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36522024-12-06T02:49:00.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36532024-12-06T02:49:00.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36542024-12-06T02:49:00.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36552024-12-06T02:49:00.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36562024-12-06T02:49:00.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36572024-12-06T02:49:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36582024-12-06T02:49:00.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36592024-12-06T02:49:00.368ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36602024-12-06T02:49:00.368ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab79cf63-ea2d-4349-a853-623cd1d6e339", "content-length": "26", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
36612024-12-06T02:49:00.368ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36622024-12-06T02:49:00.371ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36632024-12-06T02:49:00.374ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
36642024-12-06T02:49:00.374ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 273.278216ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36652024-12-06T02:49:00.406ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 305.023733ms iteration = 18 status = {"physical_disks_added":0}
36662024-12-06T02:49:00.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
36672024-12-06T02:49:00.422ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36682024-12-06T02:49:00.423ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a75f5a9-92b4-4f83-9c25-bd9108dbdf63", "content-length": "26", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
36692024-12-06T02:49:00.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36702024-12-06T02:49:00.426ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
36712024-12-06T02:49:00.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36722024-12-06T02:49:00.428ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a410342e-d997-40a6-b9cd-fe349a970f94", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36732024-12-06T02:49:00.428ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36742024-12-06T02:49:00.430ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b32cda1d-7dc5-4b64-8738-05ca6f163b27", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36752024-12-06T02:49:00.430ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36762024-12-06T02:49:00.433ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36772024-12-06T02:49:00.433ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.038564ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36782024-12-06T02:49:00.468ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36792024-12-06T02:49:00.468ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "61cb446f-fabf-49f3-8a3e-cf462372c7b0", "content-length": "1", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
36802024-12-06T02:49:00.470ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36812024-12-06T02:49:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36822024-12-06T02:49:00.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = daaef779-fe35-4f7f-b67d-6d001537d6af roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
36832024-12-06T02:49:00.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = daaef779-fe35-4f7f-b67d-6d001537d6af resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
36842024-12-06T02:49:00.492ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36852024-12-06T02:49:00.492ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36862024-12-06T02:49:00.492ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8bfc71a-e881-48f5-9d61-09782d05681f", "content-length": "372", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
36872024-12-06T02:49:00.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36882024-12-06T02:49:00.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36892024-12-06T02:49:00.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36902024-12-06T02:49:00.495ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
36912024-12-06T02:49:00.495ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36922024-12-06T02:49:00.495ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
36932024-12-06T02:49:00.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 394.1969ms iteration = 9 status = {"generation":2}
36942024-12-06T02:49:00.495ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 394.664773ms iteration = 15 status = 0
36952024-12-06T02:49:00.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36962024-12-06T02:49:00.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36972024-12-06T02:49:00.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36982024-12-06T02:49:00.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = daaef779-fe35-4f7f-b67d-6d001537d6af response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
36992024-12-06T02:49:00.498ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 397.691579ms iteration = 15 status = null
37002024-12-06T02:49:00.517ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37012024-12-06T02:49:00.517ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37022024-12-06T02:49:00.517ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cbeabfd8-8afe-4a8a-8ed6-2c9c7210aceb", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37032024-12-06T02:49:00.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37042024-12-06T02:49:00.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37052024-12-06T02:49:00.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37062024-12-06T02:49:00.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37072024-12-06T02:49:00.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37082024-12-06T02:49:00.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37092024-12-06T02:49:00.527ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37102024-12-06T02:49:00.527ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37112024-12-06T02:49:00.527ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "077b7fc4-aacd-4ae1-bbf4-e8888845cdf7", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37122024-12-06T02:49:00.529ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.882962ms iteration = 16 status = {}
37132024-12-06T02:49:00.536ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
37142024-12-06T02:49:00.536ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 435.51523ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37152024-12-06T02:49:00.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37162024-12-06T02:49:00.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37172024-12-06T02:49:00.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37182024-12-06T02:49:00.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37192024-12-06T02:49:00.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37202024-12-06T02:49:00.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37212024-12-06T02:49:00.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37222024-12-06T02:49:00.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37232024-12-06T02:49:00.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37242024-12-06T02:49:00.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37252024-12-06T02:49:00.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37262024-12-06T02:49:00.565ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.86791ms iteration = 15 status = {}
37272024-12-06T02:49:00.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37282024-12-06T02:49:00.641ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "543c76c5-2432-47ab-b8e4-618868018437", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37292024-12-06T02:49:00.641ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37302024-12-06T02:49:00.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f4d28cf0-010d-4369-8331-d503eed66c61", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37312024-12-06T02:49:00.643ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37322024-12-06T02:49:00.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8c143c3e-8c05-4fbb-9758-447a06ca5068", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37332024-12-06T02:49:00.645ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37342024-12-06T02:49:00.647ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
37352024-12-06T02:49:00.647ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 546.378857ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37362024-12-06T02:49:00.695ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37372024-12-06T02:49:00.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37382024-12-06T02:49:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37392024-12-06T02:49:00.701ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
37402024-12-06T02:49:00.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37412024-12-06T02:49:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37422024-12-06T02:49:00.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37432024-12-06T02:49:00.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a829ec-015e-4e96-a597-4b14cbb72e1d", "content-length": "134", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37442024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37452024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
37462024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37472024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37482024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37492024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37502024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37512024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37522024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37532024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37542024-12-06T02:49:00.715ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
37552024-12-06T02:49:00.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37562024-12-06T02:49:00.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37572024-12-06T02:49:00.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37582024-12-06T02:49:00.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ee7f669-6a15-47f4-bcd9-aeff2654745e", "content-length": "2", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37592024-12-06T02:49:00.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37602024-12-06T02:49:00.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee052ce5-230e-440c-9a26-b9a45a2b60e6", "content-length": "52", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37612024-12-06T02:49:00.718ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
37622024-12-06T02:49:00.718ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37632024-12-06T02:49:00.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "414014c7-dc99-44ba-9b05-27fc36950100", "content-length": "691", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37642024-12-06T02:49:00.780ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37652024-12-06T02:49:00.780ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37662024-12-06T02:49:00.780ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37672024-12-06T02:49:00.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 680.387044ms iteration = 15 status = {}
37682024-12-06T02:49:00.871ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2d6742ee-e384-44cd-86b8-3ad6214ec91c", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37692024-12-06T02:49:00.871ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
37702024-12-06T02:49:00.871ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37712024-12-06T02:49:00.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b39792e4-b684-48ae-a8a8-75b22016a121", "content-length": "682", "date": "Fri, 06 Dec 2024 02:49:00 GMT"} })
37722024-12-06T02:49:00.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37732024-12-06T02:49:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37742024-12-06T02:49:00.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37752024-12-06T02:49:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37762024-12-06T02:49:00.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37772024-12-06T02:49:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37782024-12-06T02:49:00.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37792024-12-06T02:49:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37802024-12-06T02:49:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 792.858026ms iteration = 15 status = {}
37812024-12-06T02:49:01.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3b597c20-dd46-44cd-a123-76b8ed8b590c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37822024-12-06T02:49:01.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3b597c20-dd46-44cd-a123-76b8ed8b590c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37832024-12-06T02:49:01.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3b597c20-dd46-44cd-a123-76b8ed8b590c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37842024-12-06T02:49:01.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = b386518c-5ada-42a8-b07d-5e19f262eff7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37852024-12-06T02:49:01.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = b386518c-5ada-42a8-b07d-5e19f262eff7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37862024-12-06T02:49:01.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = b386518c-5ada-42a8-b07d-5e19f262eff7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37872024-12-06T02:49:02.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50c6c449-17dc-4789-898d-87881d730882 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37882024-12-06T02:49:02.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50c6c449-17dc-4789-898d-87881d730882 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37892024-12-06T02:49:02.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50c6c449-17dc-4789-898d-87881d730882 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37902024-12-06T02:49:03.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b203e475-de4e-4e4c-9749-c3d50c25c6f7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37912024-12-06T02:49:03.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b203e475-de4e-4e4c-9749-c3d50c25c6f7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37922024-12-06T02:49:03.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b203e475-de4e-4e4c-9749-c3d50c25c6f7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37932024-12-06T02:49:04.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eee5c3f1-1e67-46f6-ba3c-0eb7a9bc0ef3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37942024-12-06T02:49:04.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eee5c3f1-1e67-46f6-ba3c-0eb7a9bc0ef3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37952024-12-06T02:49:04.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = eee5c3f1-1e67-46f6-ba3c-0eb7a9bc0ef3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37962024-12-06T02:49:05.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1383 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 98ebcad6-bbad-4763-a3a8-d3c6f9020f8c response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
37972024-12-06T02:49:05.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cec20af6-2b33-417a-ab52-31842374df98 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37982024-12-06T02:49:05.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cec20af6-2b33-417a-ab52-31842374df98 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
37992024-12-06T02:49:05.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cec20af6-2b33-417a-ab52-31842374df98 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38002024-12-06T02:49:06.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8653d637-1542-4958-95fc-dc77fbb84a6d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38012024-12-06T02:49:06.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8653d637-1542-4958-95fc-dc77fbb84a6d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38022024-12-06T02:49:06.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8653d637-1542-4958-95fc-dc77fbb84a6d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38032024-12-06T02:49:07.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 54a060cb-46a7-4d2a-9981-02202a9c2e70 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38042024-12-06T02:49:07.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 54a060cb-46a7-4d2a-9981-02202a9c2e70 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38052024-12-06T02:49:07.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 54a060cb-46a7-4d2a-9981-02202a9c2e70 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38062024-12-06T02:49:08.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 04d8035f-8601-4429-b032-1facb684304f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38072024-12-06T02:49:08.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 04d8035f-8601-4429-b032-1facb684304f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38082024-12-06T02:49:08.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 04d8035f-8601-4429-b032-1facb684304f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38092024-12-06T02:49:09.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c8a0f08-5cae-4abc-bf56-7c209dce3fd9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38102024-12-06T02:49:09.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c8a0f08-5cae-4abc-bf56-7c209dce3fd9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38112024-12-06T02:49:09.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c8a0f08-5cae-4abc-bf56-7c209dce3fd9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38122024-12-06T02:49:10.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
38132024-12-06T02:49:10.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
38142024-12-06T02:49:10.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38152024-12-06T02:49:10.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38162024-12-06T02:49:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38172024-12-06T02:49:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38182024-12-06T02:49:10.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38192024-12-06T02:49:10.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38202024-12-06T02:49:10.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38212024-12-06T02:49:10.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.556672ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38222024-12-06T02:49:10.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38232024-12-06T02:49:10.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38242024-12-06T02:49:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38252024-12-06T02:49:10.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38262024-12-06T02:49:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38272024-12-06T02:49:10.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38282024-12-06T02:49:10.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
38292024-12-06T02:49:10.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38302024-12-06T02:49:10.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38312024-12-06T02:49:10.118ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
38322024-12-06T02:49:10.118ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.578742ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
38332024-12-06T02:49:10.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 24fbab00-ef27-4898-bcc0-694168195a6e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38342024-12-06T02:49:10.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 24fbab00-ef27-4898-bcc0-694168195a6e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38352024-12-06T02:49:10.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 24fbab00-ef27-4898-bcc0-694168195a6e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38362024-12-06T02:49:11.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f206bc2d-941f-4584-bd77-05e3bf263a92 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38372024-12-06T02:49:11.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f206bc2d-941f-4584-bd77-05e3bf263a92 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38382024-12-06T02:49:11.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f206bc2d-941f-4584-bd77-05e3bf263a92 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38392024-12-06T02:49:12.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92c2c6c3-bbd7-4f3c-9857-bbff67b163d2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38402024-12-06T02:49:12.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92c2c6c3-bbd7-4f3c-9857-bbff67b163d2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38412024-12-06T02:49:12.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92c2c6c3-bbd7-4f3c-9857-bbff67b163d2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38422024-12-06T02:49:13.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebd07dc9-0124-4764-8e28-f5d9648ee602 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38432024-12-06T02:49:13.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebd07dc9-0124-4764-8e28-f5d9648ee602 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38442024-12-06T02:49:13.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebd07dc9-0124-4764-8e28-f5d9648ee602 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38452024-12-06T02:49:14.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4ad3467b-481c-4688-b81b-19cbedeb9f34 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38462024-12-06T02:49:14.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4ad3467b-481c-4688-b81b-19cbedeb9f34 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38472024-12-06T02:49:14.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4ad3467b-481c-4688-b81b-19cbedeb9f34 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38482024-12-06T02:49:15.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 1453514c-7cd2-4070-aff4-7aecf185ccd8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
38492024-12-06T02:49:15.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 1453514c-7cd2-4070-aff4-7aecf185ccd8 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
38502024-12-06T02:49:15.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 1453514c-7cd2-4070-aff4-7aecf185ccd8 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
38512024-12-06T02:49:15.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 0e7c227f-c67e-41c5-9808-786e1565415b roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
38522024-12-06T02:49:15.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 0e7c227f-c67e-41c5-9808-786e1565415b resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
38532024-12-06T02:49:15.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 0e7c227f-c67e-41c5-9808-786e1565415b response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
38542024-12-06T02:49:15.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1146 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 91153b26-8bd0-4516-b8a1-81ef482d3fc2 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
38552024-12-06T02:49:15.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8458197e-9b2f-4acd-bbfc-618d823079e3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38562024-12-06T02:49:15.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8458197e-9b2f-4acd-bbfc-618d823079e3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38572024-12-06T02:49:15.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8458197e-9b2f-4acd-bbfc-618d823079e3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38582024-12-06T02:49:16.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aa59faef-19d4-4971-ac8d-f1bdbe3b526d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38592024-12-06T02:49:16.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aa59faef-19d4-4971-ac8d-f1bdbe3b526d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38602024-12-06T02:49:16.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aa59faef-19d4-4971-ac8d-f1bdbe3b526d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38612024-12-06T02:49:17.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41c9bd26-dd5b-4ca6-b9df-1656c46a00e9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38622024-12-06T02:49:17.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41c9bd26-dd5b-4ca6-b9df-1656c46a00e9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38632024-12-06T02:49:17.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41c9bd26-dd5b-4ca6-b9df-1656c46a00e9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38642024-12-06T02:49:18.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d840cf1b-aaff-43ca-a036-0df861dd540d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38652024-12-06T02:49:18.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d840cf1b-aaff-43ca-a036-0df861dd540d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38662024-12-06T02:49:18.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d840cf1b-aaff-43ca-a036-0df861dd540d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38672024-12-06T02:49:19.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75ff1f3c-6360-43c2-9dc1-cc9e303704b2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38682024-12-06T02:49:19.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75ff1f3c-6360-43c2-9dc1-cc9e303704b2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38692024-12-06T02:49:19.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75ff1f3c-6360-43c2-9dc1-cc9e303704b2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38702024-12-06T02:49:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
38712024-12-06T02:49:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38722024-12-06T02:49:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
38732024-12-06T02:49:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38742024-12-06T02:49:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38752024-12-06T02:49:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38762024-12-06T02:49:20.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38772024-12-06T02:49:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38782024-12-06T02:49:20.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792024-12-06T02:49:20.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.52349ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38802024-12-06T02:49:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38812024-12-06T02:49:20.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38822024-12-06T02:49:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38832024-12-06T02:49:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38842024-12-06T02:49:20.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38852024-12-06T02:49:20.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38862024-12-06T02:49:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
38872024-12-06T02:49:20.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38882024-12-06T02:49:20.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38892024-12-06T02:49:20.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
38902024-12-06T02:49:20.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.127271ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
38912024-12-06T02:49:20.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c84660a-49e1-451e-9cfe-a705f1f80ad3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38922024-12-06T02:49:20.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c84660a-49e1-451e-9cfe-a705f1f80ad3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38932024-12-06T02:49:20.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c84660a-49e1-451e-9cfe-a705f1f80ad3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38942024-12-06T02:49:21.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b3b6c0c-ee8f-4f59-bb91-1166fd823f1f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38952024-12-06T02:49:21.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b3b6c0c-ee8f-4f59-bb91-1166fd823f1f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38962024-12-06T02:49:21.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b3b6c0c-ee8f-4f59-bb91-1166fd823f1f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38972024-12-06T02:49:22.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 69b1903b-b162-496d-83eb-42829c9082cb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38982024-12-06T02:49:22.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 69b1903b-b162-496d-83eb-42829c9082cb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
38992024-12-06T02:49:22.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 69b1903b-b162-496d-83eb-42829c9082cb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39002024-12-06T02:49:24.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64ab0878-8172-465b-90ad-822a81061118 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39012024-12-06T02:49:24.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64ab0878-8172-465b-90ad-822a81061118 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39022024-12-06T02:49:24.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64ab0878-8172-465b-90ad-822a81061118 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39032024-12-06T02:49:25.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 164c559b-6bd7-41e9-9086-8d3a5cfbdc49 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39042024-12-06T02:49:25.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 164c559b-6bd7-41e9-9086-8d3a5cfbdc49 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39052024-12-06T02:49:25.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 164c559b-6bd7-41e9-9086-8d3a5cfbdc49 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39062024-12-06T02:49:25.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1186 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 012d0389-41af-45d1-9e27-0faf14e3efc2 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
39072024-12-06T02:49:26.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5b73280-9e37-478f-bb82-85c38347ba0a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39082024-12-06T02:49:26.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5b73280-9e37-478f-bb82-85c38347ba0a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39092024-12-06T02:49:26.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5b73280-9e37-478f-bb82-85c38347ba0a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39102024-12-06T02:49:27.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6298bf0e-7235-4449-ae86-1a07c6869982 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39112024-12-06T02:49:27.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6298bf0e-7235-4449-ae86-1a07c6869982 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39122024-12-06T02:49:27.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6298bf0e-7235-4449-ae86-1a07c6869982 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39132024-12-06T02:49:28.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d86c5fb6-5086-4251-bd37-66c11f3309e9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39142024-12-06T02:49:28.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d86c5fb6-5086-4251-bd37-66c11f3309e9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39152024-12-06T02:49:28.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d86c5fb6-5086-4251-bd37-66c11f3309e9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39162024-12-06T02:49:29.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 05280435-5b75-4922-bd27-1ef60d799cc9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39172024-12-06T02:49:29.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 05280435-5b75-4922-bd27-1ef60d799cc9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39182024-12-06T02:49:29.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 05280435-5b75-4922-bd27-1ef60d799cc9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
39192024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
39202024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39212024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
39222024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
39232024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39242024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
39252024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39262024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39272024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
39282024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39292024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
39302024-12-06T02:49:30.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39312024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
39322024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39332024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
39342024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39352024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39362024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
39372024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39382024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
39392024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
39402024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39412024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39422024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
39432024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39442024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
39452024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
39462024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39472024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39482024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
39492024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39502024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
39512024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39522024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
39532024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39542024-12-06T02:49:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39552024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39562024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39572024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39582024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39592024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39602024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39612024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39622024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39632024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39642024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39652024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39662024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39672024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39682024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39692024-12-06T02:49:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39702024-12-06T02:49:30.107ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.191227ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39712024-12-06T02:49:30.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6118, tv_nsec: 476854875 } })
39722024-12-06T02:49:30.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732024-12-06T02:49:30.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39742024-12-06T02:49:30.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39752024-12-06T02:49:30.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39762024-12-06T02:49:30.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39772024-12-06T02:49:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39782024-12-06T02:49:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39792024-12-06T02:49:30.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39802024-12-06T02:49:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39812024-12-06T02:49:30.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39822024-12-06T02:49:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39832024-12-06T02:49:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39842024-12-06T02:49:30.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39852024-12-06T02:49:30.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39862024-12-06T02:49:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39872024-12-06T02:49:30.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882024-12-06T02:49:30.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892024-12-06T02:49:30.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39902024-12-06T02:49:30.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39912024-12-06T02:49:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39922024-12-06T02:49:30.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39932024-12-06T02:49:30.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39942024-12-06T02:49:30.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39952024-12-06T02:49:30.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6118, tv_nsec: 491737269 } })
39962024-12-06T02:49:30.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39972024-12-06T02:49:30.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-12-06T02:49:30.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39992024-12-06T02:49:30.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40002024-12-06T02:49:30.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.206041ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40012024-12-06T02:49:30.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40022024-12-06T02:49:30.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40032024-12-06T02:49:30.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40042024-12-06T02:49:30.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40052024-12-06T02:49:30.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40062024-12-06T02:49:30.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 934ee572-4e17-4766-8396-d1472e651b31 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
40072024-12-06T02:49:30.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 934ee572-4e17-4766-8396-d1472e651b31 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
40082024-12-06T02:49:30.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40092024-12-06T02:49:30.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40102024-12-06T02:49:30.139ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6118, tv_nsec: 507438277 } })
40112024-12-06T02:49:30.141ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
40122024-12-06T02:49:30.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40132024-12-06T02:49:30.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40142024-12-06T02:49:30.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40152024-12-06T02:49:30.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40162024-12-06T02:49:30.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40172024-12-06T02:49:30.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40182024-12-06T02:49:30.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40192024-12-06T02:49:30.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40202024-12-06T02:49:30.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40212024-12-06T02:49:30.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 934ee572-4e17-4766-8396-d1472e651b31 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
40222024-12-06T02:49:30.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40232024-12-06T02:49:30.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242024-12-06T02:49:30.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
40252024-12-06T02:49:30.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40262024-12-06T02:49:30.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40272024-12-06T02:49:30.175ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40282024-12-06T02:49:30.175ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40292024-12-06T02:49:30.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40302024-12-06T02:49:30.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40312024-12-06T02:49:30.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.436954ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
40322024-12-06T02:49:30.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.593975ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
40332024-12-06T02:49:30.182ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
40342024-12-06T02:49:30.182ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.077074ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
40352024-12-06T02:49:30.182ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40362024-12-06T02:49:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40372024-12-06T02:49:30.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40382024-12-06T02:49:30.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40392024-12-06T02:49:30.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40402024-12-06T02:49:30.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40412024-12-06T02:49:30.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.893342ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40422024-12-06T02:49:30.187ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40432024-12-06T02:49:30.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40442024-12-06T02:49:30.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40452024-12-06T02:49:30.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40462024-12-06T02:49:30.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.681798ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40472024-12-06T02:49:30.193ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40482024-12-06T02:49:30.193ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.193692ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40492024-12-06T02:49:30.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40502024-12-06T02:49:30.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40512024-12-06T02:49:30.196ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40522024-12-06T02:49:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
40532024-12-06T02:49:30.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40542024-12-06T02:49:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40552024-12-06T02:49:30.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40562024-12-06T02:49:30.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40572024-12-06T02:49:30.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582024-12-06T02:49:30.200ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.378838ms iteration = 16 status = 0
40592024-12-06T02:49:30.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40602024-12-06T02:49:30.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40612024-12-06T02:49:30.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40622024-12-06T02:49:30.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40632024-12-06T02:49:30.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40642024-12-06T02:49:30.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40652024-12-06T02:49:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40662024-12-06T02:49:30.220ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40672024-12-06T02:49:30.220ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40682024-12-06T02:49:30.220ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e3316eb-227d-4e98-9d67-d99ffc0a4190", "content-length": "26", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
40692024-12-06T02:49:30.220ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40702024-12-06T02:49:30.223ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40712024-12-06T02:49:30.225ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40722024-12-06T02:49:30.225ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40732024-12-06T02:49:30.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40742024-12-06T02:49:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40752024-12-06T02:49:30.235ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
40762024-12-06T02:49:30.235ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40772024-12-06T02:49:30.235ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95b31756-4818-4c6a-872a-76ee903abffe", "content-length": "26", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
40782024-12-06T02:49:30.235ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40792024-12-06T02:49:30.237ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
40802024-12-06T02:49:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 138.510756ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40812024-12-06T02:49:30.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.652596ms iteration = 19 status = {"physical_disks_added":0}
40822024-12-06T02:49:30.289ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40832024-12-06T02:49:30.290ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40842024-12-06T02:49:30.290ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b670061a-9b40-4cb2-8b09-d3e9b768c362", "content-length": "26", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
40852024-12-06T02:49:30.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40862024-12-06T02:49:30.292ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40872024-12-06T02:49:30.336ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40882024-12-06T02:49:30.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd8178c7-076e-422e-a016-5cd584475bcc", "content-length": "691", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
40892024-12-06T02:49:30.337ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
40902024-12-06T02:49:30.337ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
40912024-12-06T02:49:30.337ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
40922024-12-06T02:49:30.339ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 237.862663ms iteration = 16 status = {}
40932024-12-06T02:49:30.364ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 263.31307ms iteration = 16 status = {}
40942024-12-06T02:49:30.365ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40952024-12-06T02:49:30.365ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40962024-12-06T02:49:30.365ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 264.092773ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40972024-12-06T02:49:30.366ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40982024-12-06T02:49:30.366ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40992024-12-06T02:49:30.367ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "23d37403-b7f2-4e74-aad2-7cc7d8d04b6b", "content-length": "372", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
41002024-12-06T02:49:30.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41012024-12-06T02:49:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41022024-12-06T02:49:30.389ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41032024-12-06T02:49:30.389ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "84c1ecf1-cc7a-4119-af1f-6315f0b2f5c2", "content-length": "1", "date": "Fri, 06 Dec 2024 02:49:29 GMT"} })
41042024-12-06T02:49:30.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41052024-12-06T02:49:30.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41062024-12-06T02:49:30.393ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.340219ms iteration = 16 status = null
41072024-12-06T02:49:30.413ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41082024-12-06T02:49:30.413ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41092024-12-06T02:49:30.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41102024-12-06T02:49:30.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41112024-12-06T02:49:30.438ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
41122024-12-06T02:49:30.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41132024-12-06T02:49:30.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41142024-12-06T02:49:30.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41152024-12-06T02:49:30.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bba89fce-d5e8-431b-8d0d-5531439762eb", "content-length": "134", "date": "Fri, 06 Dec 2024 02:49:29 GMT"} })
41162024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41172024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
41182024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41192024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41202024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41212024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41222024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41232024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41242024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41252024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41262024-12-06T02:49:30.448ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
41272024-12-06T02:49:30.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41282024-12-06T02:49:30.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41292024-12-06T02:49:30.451ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41302024-12-06T02:49:30.451ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "562e434b-496e-41b8-88a9-66d331b6d326", "content-length": "2", "date": "Fri, 06 Dec 2024 02:49:29 GMT"} })
41312024-12-06T02:49:30.451ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41322024-12-06T02:49:30.451ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cbc29a8-621c-42ab-8187-43659b5b4196", "content-length": "52", "date": "Fri, 06 Dec 2024 02:49:29 GMT"} })
41332024-12-06T02:49:30.451ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
41342024-12-06T02:49:30.451ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41352024-12-06T02:49:30.482ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51080
41362024-12-06T02:49:30.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51080 req_id = 1d16c9d5-4a36-445c-964a-97c10dbde12c roles = RoleSet { roles: {} } uri = /metrics/producers
41372024-12-06T02:49:30.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51080 req_id = 1d16c9d5-4a36-445c-964a-97c10dbde12c resource = Database result = Ok(()) uri = /metrics/producers
41382024-12-06T02:49:30.484ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f439492b-9a89-476d-b0bb-fc16350a59d0", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
41392024-12-06T02:49:30.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41402024-12-06T02:49:30.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41412024-12-06T02:49:30.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41422024-12-06T02:49:30.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41432024-12-06T02:49:30.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41442024-12-06T02:49:30.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41452024-12-06T02:49:30.492ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41462024-12-06T02:49:30.492ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41472024-12-06T02:49:30.493ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9fdcbb56-0eff-41e1-8887-fb9e5aa27d51", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
41482024-12-06T02:49:30.495ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 393.86493ms iteration = 17 status = {}
41492024-12-06T02:49:30.531ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 6379dfe0-2a46-4638-967d-13828cc17f6c
41502024-12-06T02:49:30.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49421 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51080 req_id = 1d16c9d5-4a36-445c-964a-97c10dbde12c response_code = 201 uri = /metrics/producers
41512024-12-06T02:49:30.673ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0efc7870-dae0-4913-a295-fbaae439d313", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
41522024-12-06T02:49:30.673ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
41532024-12-06T02:49:30.673ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41542024-12-06T02:49:30.673ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcdf5126-cfae-4769-93ec-4417ef4c9464", "content-length": "682", "date": "Fri, 06 Dec 2024 02:49:30 GMT"} })
41552024-12-06T02:49:30.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41562024-12-06T02:49:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41572024-12-06T02:49:30.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41582024-12-06T02:49:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41592024-12-06T02:49:30.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41602024-12-06T02:49:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41612024-12-06T02:49:30.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41622024-12-06T02:49:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41632024-12-06T02:49:30.689ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 588.596772ms iteration = 16 status = {}
41642024-12-06T02:49:30.789ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39650
41652024-12-06T02:49:30.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39650 req_id = 3c407a1c-8e95-42c7-9f67-de774f819b68 roles = RoleSet { roles: {} } uri = /metrics/producers
41662024-12-06T02:49:30.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39650 req_id = 3c407a1c-8e95-42c7-9f67-de774f819b68 resource = Database result = Ok(()) uri = /metrics/producers
41672024-12-06T02:49:30.825ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3c6a3a2f-feb7-45e4-8652-d9c5f1a56f83
41682024-12-06T02:49:30.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35939 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39650 req_id = 3c407a1c-8e95-42c7-9f67-de774f819b68 response_code = 201 uri = /metrics/producers
41692024-12-06T02:49:31.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 505c68d4-6b4d-4d13-893e-a1c23bf77849 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41702024-12-06T02:49:31.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 505c68d4-6b4d-4d13-893e-a1c23bf77849 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41712024-12-06T02:49:31.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 505c68d4-6b4d-4d13-893e-a1c23bf77849 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41722024-12-06T02:49:31.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ce55d83d-e8d9-433e-84da-e5739a2661db roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41732024-12-06T02:49:31.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ce55d83d-e8d9-433e-84da-e5739a2661db resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41742024-12-06T02:49:31.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ce55d83d-e8d9-433e-84da-e5739a2661db response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41752024-12-06T02:49:31.845ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51444
41762024-12-06T02:49:31.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51444 req_id = 8e7e73c8-844b-44c7-8e46-e51a2b421e1e roles = RoleSet { roles: {} } uri = /metrics/producers
41772024-12-06T02:49:31.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51444 req_id = 8e7e73c8-844b-44c7-8e46-e51a2b421e1e resource = Database result = Ok(()) uri = /metrics/producers
41782024-12-06T02:49:31.881ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 51153a4a-2459-4cf7-8ef8-603fcdf9d4a3
41792024-12-06T02:49:31.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35809 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51444 req_id = 8e7e73c8-844b-44c7-8e46-e51a2b421e1e response_code = 201 uri = /metrics/producers
41802024-12-06T02:49:31.940ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33850
41812024-12-06T02:49:31.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33850 req_id = 75e23140-30c7-4278-b588-383126f7bb47 roles = RoleSet { roles: {} } uri = /metrics/producers
41822024-12-06T02:49:31.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33850 req_id = 75e23140-30c7-4278-b588-383126f7bb47 resource = Database result = Ok(()) uri = /metrics/producers
41832024-12-06T02:49:31.982ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
41842024-12-06T02:49:31.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42222 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33850 req_id = 75e23140-30c7-4278-b588-383126f7bb47 response_code = 201 uri = /metrics/producers
41852024-12-06T02:49:32.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6775065c-33bf-4664-ba70-66b37bf5b927 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41862024-12-06T02:49:32.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6775065c-33bf-4664-ba70-66b37bf5b927 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41872024-12-06T02:49:32.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6775065c-33bf-4664-ba70-66b37bf5b927 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41882024-12-06T02:49:33.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e208d3b-bad6-4963-a5d0-0e9ed50e8e34 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41892024-12-06T02:49:33.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e208d3b-bad6-4963-a5d0-0e9ed50e8e34 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41902024-12-06T02:49:33.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e208d3b-bad6-4963-a5d0-0e9ed50e8e34 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41912024-12-06T02:49:33.484ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36768
41922024-12-06T02:49:33.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36768 req_id = 8e95be1b-72fb-4764-a468-dc0b23096aff roles = RoleSet { roles: {} } uri = /metrics/producers
41932024-12-06T02:49:33.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36768 req_id = 8e95be1b-72fb-4764-a468-dc0b23096aff resource = Database result = Ok(()) uri = /metrics/producers
41942024-12-06T02:49:33.494ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 37960cb7-3354-4d05-b7eb-4cf4f416256d
41952024-12-06T02:49:33.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10522 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36768 req_id = 8e95be1b-72fb-4764-a468-dc0b23096aff response_code = 201 uri = /metrics/producers
41962024-12-06T02:49:34.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba96b1e1-2cbc-4b2b-87a7-325a4925949b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41972024-12-06T02:49:34.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba96b1e1-2cbc-4b2b-87a7-325a4925949b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41982024-12-06T02:49:34.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba96b1e1-2cbc-4b2b-87a7-325a4925949b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
41992024-12-06T02:49:35.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1397 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = ff4aa858-db04-45d6-87de-eace504d2ca0 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
42002024-12-06T02:49:35.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 27e5d68c-0ab2-4974-b9f8-5a3996c1956a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42012024-12-06T02:49:35.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 27e5d68c-0ab2-4974-b9f8-5a3996c1956a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42022024-12-06T02:49:35.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 27e5d68c-0ab2-4974-b9f8-5a3996c1956a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42032024-12-06T02:49:36.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7ee30e54-84c7-414a-9e22-b96ff58a9344 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42042024-12-06T02:49:36.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7ee30e54-84c7-414a-9e22-b96ff58a9344 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42052024-12-06T02:49:36.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7ee30e54-84c7-414a-9e22-b96ff58a9344 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42062024-12-06T02:49:37.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0daaaa49-e8eb-4ec5-aa23-9fcb238c519f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42072024-12-06T02:49:37.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0daaaa49-e8eb-4ec5-aa23-9fcb238c519f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42082024-12-06T02:49:37.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0daaaa49-e8eb-4ec5-aa23-9fcb238c519f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42092024-12-06T02:49:38.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4f3ba207-d8a7-4821-9dcd-e5792d483048 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42102024-12-06T02:49:38.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4f3ba207-d8a7-4821-9dcd-e5792d483048 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42112024-12-06T02:49:38.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4f3ba207-d8a7-4821-9dcd-e5792d483048 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42122024-12-06T02:49:39.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 98659280-e450-4edb-b444-faa74b11d2b0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42132024-12-06T02:49:39.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 98659280-e450-4edb-b444-faa74b11d2b0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42142024-12-06T02:49:39.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 98659280-e450-4edb-b444-faa74b11d2b0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42152024-12-06T02:49:40.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
42162024-12-06T02:49:40.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42172024-12-06T02:49:40.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
42182024-12-06T02:49:40.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42192024-12-06T02:49:40.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42202024-12-06T02:49:40.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42212024-12-06T02:49:40.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42222024-12-06T02:49:40.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42232024-12-06T02:49:40.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42242024-12-06T02:49:40.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42252024-12-06T02:49:40.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42262024-12-06T02:49:40.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42272024-12-06T02:49:40.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42282024-12-06T02:49:40.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42292024-12-06T02:49:40.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302024-12-06T02:49:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
42312024-12-06T02:49:40.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42322024-12-06T02:49:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42332024-12-06T02:49:40.120ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
42342024-12-06T02:49:40.120ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.045903ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
42352024-12-06T02:49:40.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.899218ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42362024-12-06T02:49:40.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2187abd0-da5a-4b3b-ab7c-ecf45a502f8a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42372024-12-06T02:49:40.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2187abd0-da5a-4b3b-ab7c-ecf45a502f8a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42382024-12-06T02:49:40.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2187abd0-da5a-4b3b-ab7c-ecf45a502f8a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42392024-12-06T02:49:41.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 108a54f5-ba3d-4c03-8a97-cec98759666d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42402024-12-06T02:49:41.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 108a54f5-ba3d-4c03-8a97-cec98759666d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42412024-12-06T02:49:41.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 108a54f5-ba3d-4c03-8a97-cec98759666d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42422024-12-06T02:49:42.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d85c8956-94af-48d3-83a0-dfa7454bd295 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42432024-12-06T02:49:42.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d85c8956-94af-48d3-83a0-dfa7454bd295 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42442024-12-06T02:49:42.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d85c8956-94af-48d3-83a0-dfa7454bd295 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42452024-12-06T02:49:43.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 694272ea-bf74-40d7-b967-89e39712d184 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42462024-12-06T02:49:43.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 694272ea-bf74-40d7-b967-89e39712d184 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42472024-12-06T02:49:43.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 694272ea-bf74-40d7-b967-89e39712d184 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42482024-12-06T02:49:44.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 520350d4-6315-470b-ae18-eed32d70198a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42492024-12-06T02:49:44.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 520350d4-6315-470b-ae18-eed32d70198a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42502024-12-06T02:49:44.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 520350d4-6315-470b-ae18-eed32d70198a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42512024-12-06T02:49:45.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = a470b7b5-5f41-4070-895b-d78fcfd4d183 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
42522024-12-06T02:49:45.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = a470b7b5-5f41-4070-895b-d78fcfd4d183 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
42532024-12-06T02:49:45.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = a470b7b5-5f41-4070-895b-d78fcfd4d183 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
42542024-12-06T02:49:45.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 85dd1cac-aa6c-4d98-bed2-17fde5673430 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
42552024-12-06T02:49:45.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 85dd1cac-aa6c-4d98-bed2-17fde5673430 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
42562024-12-06T02:49:45.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 85dd1cac-aa6c-4d98-bed2-17fde5673430 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
42572024-12-06T02:49:45.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1601 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 63cb570f-ca3d-46d4-b448-78dfaa5cc971 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
42582024-12-06T02:49:45.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e9e5f84e-8e81-41b3-97d4-da3e57ba248b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42592024-12-06T02:49:45.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e9e5f84e-8e81-41b3-97d4-da3e57ba248b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42602024-12-06T02:49:45.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e9e5f84e-8e81-41b3-97d4-da3e57ba248b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42612024-12-06T02:49:46.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c416db2a-6f6b-4c79-a6df-198018c17dbf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42622024-12-06T02:49:46.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c416db2a-6f6b-4c79-a6df-198018c17dbf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42632024-12-06T02:49:46.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c416db2a-6f6b-4c79-a6df-198018c17dbf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42642024-12-06T02:49:47.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4b291af8-bba5-4ed6-b2ee-a5ab4127096c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42652024-12-06T02:49:47.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4b291af8-bba5-4ed6-b2ee-a5ab4127096c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42662024-12-06T02:49:47.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4b291af8-bba5-4ed6-b2ee-a5ab4127096c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42672024-12-06T02:49:47.909ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58162
42682024-12-06T02:49:47.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58162 req_id = b8e63926-c199-4f3d-84a2-e7547bd19440 roles = RoleSet { roles: {} } uri = /metrics/producers
42692024-12-06T02:49:47.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58162 req_id = b8e63926-c199-4f3d-84a2-e7547bd19440 resource = Database result = Ok(()) uri = /metrics/producers
42702024-12-06T02:49:47.923ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 2dbba7e1-9c13-427e-a69e-72040b07d167
42712024-12-06T02:49:47.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14046 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58162 req_id = b8e63926-c199-4f3d-84a2-e7547bd19440 response_code = 201 uri = /metrics/producers
42722024-12-06T02:49:48.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 42c5e9f5-74b8-4081-9476-b25022ad3aaf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42732024-12-06T02:49:48.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 42c5e9f5-74b8-4081-9476-b25022ad3aaf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42742024-12-06T02:49:48.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 42c5e9f5-74b8-4081-9476-b25022ad3aaf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42752024-12-06T02:49:49.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cc309724-3464-48ef-b4dc-4ee4cb519158 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42762024-12-06T02:49:49.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cc309724-3464-48ef-b4dc-4ee4cb519158 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42772024-12-06T02:49:49.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cc309724-3464-48ef-b4dc-4ee4cb519158 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
42782024-12-06T02:49:50.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
42792024-12-06T02:49:50.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42802024-12-06T02:49:50.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
42812024-12-06T02:49:50.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42822024-12-06T02:49:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42832024-12-06T02:49:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42842024-12-06T02:49:50.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42852024-12-06T02:49:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42862024-12-06T02:49:50.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872024-12-06T02:49:50.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.767387ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42882024-12-06T02:49:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42892024-12-06T02:49:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42902024-12-06T02:49:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42912024-12-06T02:49:50.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42922024-12-06T02:49:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42932024-12-06T02:49:50.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42942024-12-06T02:49:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
42952024-12-06T02:49:50.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42962024-12-06T02:49:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42972024-12-06T02:49:50.119ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
42982024-12-06T02:49:50.119ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.670312ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
42992024-12-06T02:49:50.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dee1433b-1763-4d01-b301-00fd68b8e545 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43002024-12-06T02:49:50.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dee1433b-1763-4d01-b301-00fd68b8e545 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43012024-12-06T02:49:50.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dee1433b-1763-4d01-b301-00fd68b8e545 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43022024-12-06T02:49:51.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c044c88-e403-47bf-9fac-657149ca1007 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43032024-12-06T02:49:51.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c044c88-e403-47bf-9fac-657149ca1007 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43042024-12-06T02:49:51.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c044c88-e403-47bf-9fac-657149ca1007 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43052024-12-06T02:49:52.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dffd5bb9-5a30-4ef3-be11-aaa3dc617d33 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43062024-12-06T02:49:52.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dffd5bb9-5a30-4ef3-be11-aaa3dc617d33 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43072024-12-06T02:49:52.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dffd5bb9-5a30-4ef3-be11-aaa3dc617d33 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43082024-12-06T02:49:53.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6f1113c5-866c-462f-b6bf-31bb8672eeeb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43092024-12-06T02:49:53.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6f1113c5-866c-462f-b6bf-31bb8672eeeb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43102024-12-06T02:49:53.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6f1113c5-866c-462f-b6bf-31bb8672eeeb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43112024-12-06T02:49:54.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab404594-7536-4b95-a393-9e92c77a81d0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43122024-12-06T02:49:54.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab404594-7536-4b95-a393-9e92c77a81d0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43132024-12-06T02:49:54.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab404594-7536-4b95-a393-9e92c77a81d0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43142024-12-06T02:49:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1184 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 0bcabbcf-cc53-462a-883e-ea69af6bd6c1 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
43152024-12-06T02:49:55.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 74c094f2-b6ae-4c31-8997-cdaaf4976cc2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43162024-12-06T02:49:55.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 74c094f2-b6ae-4c31-8997-cdaaf4976cc2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43172024-12-06T02:49:55.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 74c094f2-b6ae-4c31-8997-cdaaf4976cc2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43182024-12-06T02:49:56.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0618e7cb-7dbf-448f-823a-81453674a30f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43192024-12-06T02:49:56.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0618e7cb-7dbf-448f-823a-81453674a30f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43202024-12-06T02:49:56.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0618e7cb-7dbf-448f-823a-81453674a30f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43212024-12-06T02:49:57.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6c72ad56-215c-44b9-9d1a-48b29014bfb4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43222024-12-06T02:49:57.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6c72ad56-215c-44b9-9d1a-48b29014bfb4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43232024-12-06T02:49:57.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6c72ad56-215c-44b9-9d1a-48b29014bfb4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43242024-12-06T02:49:58.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41900d82-8441-4d9c-a607-2c02abe04e7e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43252024-12-06T02:49:58.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41900d82-8441-4d9c-a607-2c02abe04e7e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43262024-12-06T02:49:58.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 41900d82-8441-4d9c-a607-2c02abe04e7e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43272024-12-06T02:49:59.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 98914a95-effa-4da8-9414-7ad2fb837c22 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43282024-12-06T02:49:59.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 98914a95-effa-4da8-9414-7ad2fb837c22 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43292024-12-06T02:49:59.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 98914a95-effa-4da8-9414-7ad2fb837c22 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
43302024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
43312024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43322024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
43332024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43342024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43352024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
43362024-12-06T02:50:00.100ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:40:00.100406364 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43372024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
43382024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43392024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43402024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
43412024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43422024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43432024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
43442024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
43452024-12-06T02:50:00.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43462024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43472024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
43482024-12-06T02:50:00.100ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43492024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
43502024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43512024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
43522024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
43532024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43542024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
43552024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
43562024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43572024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
43582024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43592024-12-06T02:50:00.100ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
43602024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43612024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.58\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
43622024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
43632024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
43642024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43652024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
43662024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43672024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
43682024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43692024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43702024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
43712024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43722024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
43732024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43742024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
43752024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43762024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
43772024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
43782024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43792024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
43802024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43812024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43822024-12-06T02:50:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43832024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43842024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43852024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43862024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43872024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43882024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43892024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43902024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43912024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43922024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43932024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43942024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43952024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43962024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
43972024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43982024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
43992024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44002024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
44012024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
44022024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
44032024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44042024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
44052024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44062024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
44072024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
44082024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44092024-12-06T02:50:00.101ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6148, tv_nsec: 469446809 } })
44102024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44112024-12-06T02:50:00.101ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6148, tv_nsec: 469473850 } })
44122024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44132024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
44142024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44152024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
44162024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44172024-12-06T02:50:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44182024-12-06T02:50:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
44192024-12-06T02:50:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.316538ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
44202024-12-06T02:50:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
44212024-12-06T02:50:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.532384ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
44222024-12-06T02:50:00.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44232024-12-06T02:50:00.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44242024-12-06T02:50:00.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44252024-12-06T02:50:00.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44262024-12-06T02:50:00.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44272024-12-06T02:50:00.106ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.589519ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44282024-12-06T02:50:00.106ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:40:00.100406364 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44292024-12-06T02:50:00.106ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.181476ms iteration = 9 status = {"expiration":"2024-12-06T02:40:00.100406364Z","pruned":[]}
44302024-12-06T02:50:00.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44312024-12-06T02:50:00.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44322024-12-06T02:50:00.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44332024-12-06T02:50:00.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44342024-12-06T02:50:00.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44352024-12-06T02:50:00.111ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-12-06T02:50:00.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44382024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44392024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44402024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44412024-12-06T02:50:00.114ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44422024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44432024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44442024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44452024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44462024-12-06T02:50:00.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44472024-12-06T02:50:00.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6148, tv_nsec: 484756886 } })
44482024-12-06T02:50:00.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44492024-12-06T02:50:00.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44502024-12-06T02:50:00.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44512024-12-06T02:50:00.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44522024-12-06T02:50:00.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44532024-12-06T02:50:00.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44542024-12-06T02:50:00.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44552024-12-06T02:50:00.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44562024-12-06T02:50:00.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44572024-12-06T02:50:00.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44582024-12-06T02:50:00.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44592024-12-06T02:50:00.134ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6148, tv_nsec: 501945607 } })
44602024-12-06T02:50:00.134ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
44612024-12-06T02:50:00.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622024-12-06T02:50:00.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632024-12-06T02:50:00.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44642024-12-06T02:50:00.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44652024-12-06T02:50:00.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44662024-12-06T02:50:00.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44672024-12-06T02:50:00.142ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44682024-12-06T02:50:00.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44692024-12-06T02:50:00.145ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 44.364236ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
44702024-12-06T02:50:00.145ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44712024-12-06T02:50:00.145ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44722024-12-06T02:50:00.145ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 44.457029ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44732024-12-06T02:50:00.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44742024-12-06T02:50:00.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44752024-12-06T02:50:00.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762024-12-06T02:50:00.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44772024-12-06T02:50:00.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44782024-12-06T02:50:00.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44792024-12-06T02:50:00.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44802024-12-06T02:50:00.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44812024-12-06T02:50:00.165ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44822024-12-06T02:50:00.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44832024-12-06T02:50:00.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.614484ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
44842024-12-06T02:50:00.171ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44852024-12-06T02:50:00.171ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44862024-12-06T02:50:00.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44872024-12-06T02:50:00.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44882024-12-06T02:50:00.174ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6148, tv_nsec: 542179576 } })
44892024-12-06T02:50:00.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
44902024-12-06T02:50:00.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44912024-12-06T02:50:00.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44922024-12-06T02:50:00.193ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-12-06T02:50:00.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44942024-12-06T02:50:00.196ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44952024-12-06T02:50:00.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44962024-12-06T02:50:00.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44972024-12-06T02:50:00.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44982024-12-06T02:50:00.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44992024-12-06T02:50:00.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45002024-12-06T02:50:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45012024-12-06T02:50:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45022024-12-06T02:50:00.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45032024-12-06T02:50:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45042024-12-06T02:50:00.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45052024-12-06T02:50:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45062024-12-06T02:50:00.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45072024-12-06T02:50:00.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 120.79546ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
45082024-12-06T02:50:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45092024-12-06T02:50:00.239ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45102024-12-06T02:50:00.239ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45112024-12-06T02:50:00.239ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45122024-12-06T02:50:00.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45132024-12-06T02:50:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45142024-12-06T02:50:00.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45152024-12-06T02:50:00.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45162024-12-06T02:50:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45172024-12-06T02:50:00.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45182024-12-06T02:50:00.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45192024-12-06T02:50:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45202024-12-06T02:50:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45212024-12-06T02:50:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45222024-12-06T02:50:00.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45232024-12-06T02:50:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45242024-12-06T02:50:00.251ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45252024-12-06T02:50:00.251ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45262024-12-06T02:50:00.251ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 151.162967ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45272024-12-06T02:50:00.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45282024-12-06T02:50:00.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292024-12-06T02:50:00.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
45302024-12-06T02:50:00.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45312024-12-06T02:50:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45322024-12-06T02:50:00.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45332024-12-06T02:50:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
45342024-12-06T02:50:00.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45352024-12-06T02:50:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45362024-12-06T02:50:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45372024-12-06T02:50:00.260ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45382024-12-06T02:50:00.260ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
45392024-12-06T02:50:00.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45402024-12-06T02:50:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45412024-12-06T02:50:00.262ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 161.732468ms iteration = 17 status = 0
45422024-12-06T02:50:00.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45432024-12-06T02:50:00.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 165.506536ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45442024-12-06T02:50:00.267ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452024-12-06T02:50:00.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45462024-12-06T02:50:00.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45472024-12-06T02:50:00.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45482024-12-06T02:50:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45492024-12-06T02:50:00.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45502024-12-06T02:50:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45512024-12-06T02:50:00.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45522024-12-06T02:50:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45532024-12-06T02:50:00.273ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
45542024-12-06T02:50:00.273ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45552024-12-06T02:50:00.273ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
45562024-12-06T02:50:00.273ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 172.837956ms iteration = 10 status = {"generation":2}
45572024-12-06T02:50:00.273ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45582024-12-06T02:50:00.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 172.459725ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45592024-12-06T02:50:00.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602024-12-06T02:50:00.274ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45612024-12-06T02:50:00.274ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45622024-12-06T02:50:00.274ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.289118ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45632024-12-06T02:50:00.276ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
45642024-12-06T02:50:00.276ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 175.743259ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
45652024-12-06T02:50:00.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45662024-12-06T02:50:00.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45672024-12-06T02:50:00.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45682024-12-06T02:50:00.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45692024-12-06T02:50:00.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45702024-12-06T02:50:00.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45712024-12-06T02:50:00.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45722024-12-06T02:50:00.282ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45732024-12-06T02:50:00.282ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45742024-12-06T02:50:00.282ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45752024-12-06T02:50:00.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45762024-12-06T02:50:00.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45772024-12-06T02:50:00.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45782024-12-06T02:50:00.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45792024-12-06T02:50:00.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45802024-12-06T02:50:00.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45812024-12-06T02:50:00.289ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45822024-12-06T02:50:00.289ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45832024-12-06T02:50:00.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45842024-12-06T02:50:00.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 188.578376ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45852024-12-06T02:50:00.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 187.992679ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45862024-12-06T02:50:00.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45872024-12-06T02:50:00.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45882024-12-06T02:50:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45892024-12-06T02:50:00.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45902024-12-06T02:50:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45912024-12-06T02:50:00.296ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45922024-12-06T02:50:00.296ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45932024-12-06T02:50:00.297ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "935185c0-63e7-4de7-bfe4-86a52bf731aa", "content-length": "26", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
45942024-12-06T02:50:00.297ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45952024-12-06T02:50:00.301ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45962024-12-06T02:50:00.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45972024-12-06T02:50:00.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45982024-12-06T02:50:00.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45992024-12-06T02:50:00.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46002024-12-06T02:50:00.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
46012024-12-06T02:50:00.338ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46022024-12-06T02:50:00.339ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d0823dd-430f-4ae9-b50c-2116c9131428", "content-length": "26", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46032024-12-06T02:50:00.339ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46042024-12-06T02:50:00.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
46052024-12-06T02:50:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 251.809781ms iteration = 20 status = {"physical_disks_added":0}
46062024-12-06T02:50:00.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46072024-12-06T02:50:00.384ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
46082024-12-06T02:50:00.384ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 283.385764ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46092024-12-06T02:50:00.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46102024-12-06T02:50:00.396ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46112024-12-06T02:50:00.396ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5745dffd-1c61-4f1c-8b6c-76a88b174208", "content-length": "26", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46122024-12-06T02:50:00.396ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46132024-12-06T02:50:00.398ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46142024-12-06T02:50:00.426ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46152024-12-06T02:50:00.501ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46162024-12-06T02:50:00.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46172024-12-06T02:50:00.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "230966c9-50c0-4697-80ae-501be1ce4df3", "content-length": "372", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46182024-12-06T02:50:00.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46192024-12-06T02:50:00.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46202024-12-06T02:50:00.502ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46212024-12-06T02:50:00.503ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a51544cf-68f3-46f4-9b9b-d03ae52717c4", "content-length": "691", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46222024-12-06T02:50:00.503ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46232024-12-06T02:50:00.503ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46242024-12-06T02:50:00.503ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46252024-12-06T02:50:00.504ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 404.207075ms iteration = 17 status = {}
46262024-12-06T02:50:00.505ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46272024-12-06T02:50:00.505ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
46282024-12-06T02:50:00.505ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46292024-12-06T02:50:00.505ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
46302024-12-06T02:50:00.505ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 405.470721ms iteration = 10 status = {"generation":1}
46312024-12-06T02:50:00.506ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46322024-12-06T02:50:00.507ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eef4701d-de13-4b78-a56d-799e5cc4fc24", "content-length": "1", "date": "Fri, 06 Dec 2024 02:49:59 GMT"} })
46332024-12-06T02:50:00.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46342024-12-06T02:50:00.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46352024-12-06T02:50:00.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46362024-12-06T02:50:00.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46372024-12-06T02:50:00.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46382024-12-06T02:50:00.511ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 410.71664ms iteration = 17 status = null
46392024-12-06T02:50:00.522ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46402024-12-06T02:50:00.522ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46412024-12-06T02:50:00.523ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "24b9d462-b09f-489c-9d11-1f540139df07", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46422024-12-06T02:50:00.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46432024-12-06T02:50:00.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46442024-12-06T02:50:00.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46452024-12-06T02:50:00.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46462024-12-06T02:50:00.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46472024-12-06T02:50:00.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46482024-12-06T02:50:00.534ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46492024-12-06T02:50:00.534ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46502024-12-06T02:50:00.534ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4041b9b0-e1b5-4dc2-a345-f157e0a0fc11", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46512024-12-06T02:50:00.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 434.071338ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46522024-12-06T02:50:00.536ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 436.447675ms iteration = 18 status = {}
46532024-12-06T02:50:00.552ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
46542024-12-06T02:50:00.552ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 451.356142ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46552024-12-06T02:50:00.557ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 456.644652ms iteration = 17 status = {}
46562024-12-06T02:50:00.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46572024-12-06T02:50:00.655ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46582024-12-06T02:50:00.655ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5809846f-eeef-4553-a52c-cd9af4ce4a59", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46592024-12-06T02:50:00.655ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46602024-12-06T02:50:00.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "18b8a93c-399b-40d2-bd54-854f8508a2a4", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46612024-12-06T02:50:00.656ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46622024-12-06T02:50:00.659ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46632024-12-06T02:50:00.659ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 558.77973ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46642024-12-06T02:50:00.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46652024-12-06T02:50:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46662024-12-06T02:50:00.693ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
46672024-12-06T02:50:00.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46682024-12-06T02:50:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46692024-12-06T02:50:00.701ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46702024-12-06T02:50:00.701ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f28779a-e9af-4f31-a20b-0454c09e0c54", "content-length": "134", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46712024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46722024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
46732024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46742024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46752024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46762024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46772024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46782024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46792024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46802024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46812024-12-06T02:50:00.701ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
46822024-12-06T02:50:00.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46832024-12-06T02:50:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842024-12-06T02:50:00.702ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46852024-12-06T02:50:00.702ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d2fd149c-5ae0-468c-8822-e164e8a6f2ef", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46862024-12-06T02:50:00.702ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46872024-12-06T02:50:00.703ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46882024-12-06T02:50:00.703ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "efccfe7e-e573-4c34-b141-e7138543d6b6", "content-length": "2", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46892024-12-06T02:50:00.704ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46902024-12-06T02:50:00.704ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9a8035b-4c78-4965-8f62-a94d690e5c2d", "content-length": "52", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
46912024-12-06T02:50:00.704ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
46922024-12-06T02:50:00.704ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46932024-12-06T02:50:00.705ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "39a1ba78-05fa-4feb-aff2-1d577e1cde4c", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46942024-12-06T02:50:00.705ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46952024-12-06T02:50:00.707ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "93aaf8cd-a4a1-4ec1-9f5d-302d4402cd41", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46962024-12-06T02:50:00.707ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46972024-12-06T02:50:00.709ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46982024-12-06T02:50:00.709ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 608.952573ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46992024-12-06T02:50:00.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a77e538-1a31-4566-af58-b0b0deb19023 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47002024-12-06T02:50:00.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a77e538-1a31-4566-af58-b0b0deb19023 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47012024-12-06T02:50:00.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a77e538-1a31-4566-af58-b0b0deb19023 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47022024-12-06T02:50:00.862ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ad096b2-c4df-471f-ac4c-1b9c547cdf9b", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
47032024-12-06T02:50:00.862ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
47042024-12-06T02:50:00.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47052024-12-06T02:50:00.862ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f895f593-5448-433b-b79c-ff88b5682e80", "content-length": "682", "date": "Fri, 06 Dec 2024 02:50:00 GMT"} })
47062024-12-06T02:50:00.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47072024-12-06T02:50:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47082024-12-06T02:50:00.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47092024-12-06T02:50:00.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47102024-12-06T02:50:00.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47112024-12-06T02:50:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47122024-12-06T02:50:00.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47132024-12-06T02:50:00.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47142024-12-06T02:50:00.880ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 779.473904ms iteration = 17 status = {}
47152024-12-06T02:50:01.489ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
47162024-12-06T02:50:01.489ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
47172024-12-06T02:50:01.520ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
47182024-12-06T02:50:01.520ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:44201
47192024-12-06T02:50:01.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44201 req_id = 0487cd8b-50e1-4ac3-8d01-540ea6c5c05c roles = RoleSet { roles: {} } uri = /metrics/producers
47202024-12-06T02:50:01.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44201 req_id = 0487cd8b-50e1-4ac3-8d01-540ea6c5c05c resource = Database result = Ok(()) uri = /metrics/producers
47212024-12-06T02:50:01.530ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3943088e-6ce0-4ada-925c-494df92c0dda
47222024-12-06T02:50:01.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10091 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44201 req_id = 0487cd8b-50e1-4ac3-8d01-540ea6c5c05c response_code = 201 uri = /metrics/producers
47232024-12-06T02:50:01.530ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0487cd8b-50e1-4ac3-8d01-540ea6c5c05c", "content-length": "41", "date": "Fri, 06 Dec 2024 02:50:01 GMT"} })
47242024-12-06T02:50:01.533ZDEBGnexus (producer-registration-task): registered with nexus successfully
47252024-12-06T02:50:01.533ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47262024-12-06T02:50:01.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 97ab0671-c8b2-4d17-bc78-2de296a88915 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
47272024-12-06T02:50:01.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 97ab0671-c8b2-4d17-bc78-2de296a88915 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
47282024-12-06T02:50:01.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 97ab0671-c8b2-4d17-bc78-2de296a88915 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
47292024-12-06T02:50:01.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7f0fee22-bc45-47fe-aab6-42b2df9f70c8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47302024-12-06T02:50:01.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7f0fee22-bc45-47fe-aab6-42b2df9f70c8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47312024-12-06T02:50:01.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7f0fee22-bc45-47fe-aab6-42b2df9f70c8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47322024-12-06T02:50:02.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 94619936-e065-4938-8290-393261bb171f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47332024-12-06T02:50:02.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 94619936-e065-4938-8290-393261bb171f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47342024-12-06T02:50:02.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 94619936-e065-4938-8290-393261bb171f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47352024-12-06T02:50:03.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1087cbe4-bb07-43f6-b87c-ef47ac36f186 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47362024-12-06T02:50:03.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1087cbe4-bb07-43f6-b87c-ef47ac36f186 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47372024-12-06T02:50:03.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1087cbe4-bb07-43f6-b87c-ef47ac36f186 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47382024-12-06T02:50:04.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 541d451a-f715-4338-9569-a52d9c0cfb26 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47392024-12-06T02:50:04.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 541d451a-f715-4338-9569-a52d9c0cfb26 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47402024-12-06T02:50:04.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 541d451a-f715-4338-9569-a52d9c0cfb26 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47412024-12-06T02:50:05.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1402 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 09dd8e9c-22cb-4b17-9136-356fd9b9f205 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
47422024-12-06T02:50:05.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bf991040-3b6e-4d15-89f9-d217b944d26c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47432024-12-06T02:50:05.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bf991040-3b6e-4d15-89f9-d217b944d26c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47442024-12-06T02:50:05.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bf991040-3b6e-4d15-89f9-d217b944d26c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47452024-12-06T02:50:06.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 45af29ad-cd21-4c2d-a381-4490a0944dde roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47462024-12-06T02:50:06.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 45af29ad-cd21-4c2d-a381-4490a0944dde resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47472024-12-06T02:50:06.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 45af29ad-cd21-4c2d-a381-4490a0944dde response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47482024-12-06T02:50:07.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93437589-ec71-4d4d-854b-55ca2dc3eb64 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47492024-12-06T02:50:07.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93437589-ec71-4d4d-854b-55ca2dc3eb64 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47502024-12-06T02:50:07.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93437589-ec71-4d4d-854b-55ca2dc3eb64 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47512024-12-06T02:50:08.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1130e6e1-5164-45bb-a7da-f64f9cceb6d5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47522024-12-06T02:50:08.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1130e6e1-5164-45bb-a7da-f64f9cceb6d5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47532024-12-06T02:50:08.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1130e6e1-5164-45bb-a7da-f64f9cceb6d5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47542024-12-06T02:50:09.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 386582c6-246a-417a-acf0-a11f5b88c48c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47552024-12-06T02:50:10.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 386582c6-246a-417a-acf0-a11f5b88c48c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47562024-12-06T02:50:10.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 386582c6-246a-417a-acf0-a11f5b88c48c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47572024-12-06T02:50:10.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
47582024-12-06T02:50:10.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
47592024-12-06T02:50:10.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47602024-12-06T02:50:10.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47612024-12-06T02:50:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47622024-12-06T02:50:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47632024-12-06T02:50:10.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47642024-12-06T02:50:10.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47652024-12-06T02:50:10.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47662024-12-06T02:50:10.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.531281ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47672024-12-06T02:50:10.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47682024-12-06T02:50:10.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47692024-12-06T02:50:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47702024-12-06T02:50:10.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47712024-12-06T02:50:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47722024-12-06T02:50:10.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732024-12-06T02:50:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
47742024-12-06T02:50:10.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752024-12-06T02:50:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762024-12-06T02:50:10.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
47772024-12-06T02:50:10.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.40354ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
47782024-12-06T02:50:11.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7b59872-a23d-4c3a-af44-f1647dd6d0d4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47792024-12-06T02:50:11.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7b59872-a23d-4c3a-af44-f1647dd6d0d4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47802024-12-06T02:50:11.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7b59872-a23d-4c3a-af44-f1647dd6d0d4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47812024-12-06T02:50:12.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 68311a1b-7d50-438d-887a-1cb623c19b19 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47822024-12-06T02:50:12.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 68311a1b-7d50-438d-887a-1cb623c19b19 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47832024-12-06T02:50:12.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 68311a1b-7d50-438d-887a-1cb623c19b19 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47842024-12-06T02:50:13.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57123b6a-60ea-4cbd-9eb1-848419876a25 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47852024-12-06T02:50:13.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57123b6a-60ea-4cbd-9eb1-848419876a25 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47862024-12-06T02:50:13.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57123b6a-60ea-4cbd-9eb1-848419876a25 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47872024-12-06T02:50:14.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 56c08051-a81f-4761-9eff-79f00d455d6f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47882024-12-06T02:50:14.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 56c08051-a81f-4761-9eff-79f00d455d6f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47892024-12-06T02:50:14.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 56c08051-a81f-4761-9eff-79f00d455d6f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47902024-12-06T02:50:15.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 328a3039-8f1f-4e68-ae88-591ad78a8776 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
47912024-12-06T02:50:15.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 328a3039-8f1f-4e68-ae88-591ad78a8776 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
47922024-12-06T02:50:15.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = 328a3039-8f1f-4e68-ae88-591ad78a8776 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
47932024-12-06T02:50:15.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = cd12cb56-219e-4c86-8fba-4183a353135a roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
47942024-12-06T02:50:15.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = cd12cb56-219e-4c86-8fba-4183a353135a resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
47952024-12-06T02:50:15.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39030 req_id = cd12cb56-219e-4c86-8fba-4183a353135a response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
47962024-12-06T02:50:15.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1137 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = b1d74bdf-3e3b-45a9-afa1-0b5230b396aa response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
47972024-12-06T02:50:15.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0347b8ad-a021-4e3f-abb4-1700f1e9943d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47982024-12-06T02:50:15.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0347b8ad-a021-4e3f-abb4-1700f1e9943d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
47992024-12-06T02:50:15.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0347b8ad-a021-4e3f-abb4-1700f1e9943d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48002024-12-06T02:50:16.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 40a99bd7-3be6-475f-a5da-b3644e4ab771 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48012024-12-06T02:50:16.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 40a99bd7-3be6-475f-a5da-b3644e4ab771 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48022024-12-06T02:50:16.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 40a99bd7-3be6-475f-a5da-b3644e4ab771 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48032024-12-06T02:50:17.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bfa10a0f-bc2d-4a0d-8b52-f1f56c9511bf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48042024-12-06T02:50:17.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bfa10a0f-bc2d-4a0d-8b52-f1f56c9511bf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48052024-12-06T02:50:17.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bfa10a0f-bc2d-4a0d-8b52-f1f56c9511bf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48062024-12-06T02:50:18.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d70bf1df-fcf1-4b2e-a1e7-2b59eb5b7511 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48072024-12-06T02:50:18.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d70bf1df-fcf1-4b2e-a1e7-2b59eb5b7511 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48082024-12-06T02:50:18.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d70bf1df-fcf1-4b2e-a1e7-2b59eb5b7511 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48092024-12-06T02:50:19.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c0ca69b3-8ddc-4f9c-b9ac-41961ce893b1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48102024-12-06T02:50:19.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c0ca69b3-8ddc-4f9c-b9ac-41961ce893b1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48112024-12-06T02:50:19.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c0ca69b3-8ddc-4f9c-b9ac-41961ce893b1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48122024-12-06T02:50:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
48132024-12-06T02:50:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
48142024-12-06T02:50:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48152024-12-06T02:50:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48162024-12-06T02:50:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48172024-12-06T02:50:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48182024-12-06T02:50:20.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48192024-12-06T02:50:20.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48202024-12-06T02:50:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48212024-12-06T02:50:20.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.135128ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48222024-12-06T02:50:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48232024-12-06T02:50:20.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242024-12-06T02:50:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48252024-12-06T02:50:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48262024-12-06T02:50:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48272024-12-06T02:50:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48282024-12-06T02:50:20.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
48292024-12-06T02:50:20.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48302024-12-06T02:50:20.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48312024-12-06T02:50:20.121ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
48322024-12-06T02:50:20.121ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.536356ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
48332024-12-06T02:50:20.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5ef27e9a-c281-42fa-b896-0d11cd282304 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48342024-12-06T02:50:20.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5ef27e9a-c281-42fa-b896-0d11cd282304 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48352024-12-06T02:50:20.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5ef27e9a-c281-42fa-b896-0d11cd282304 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48362024-12-06T02:50:21.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 423fc5be-c8c0-4418-b8e7-281373a82bff roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48372024-12-06T02:50:21.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 423fc5be-c8c0-4418-b8e7-281373a82bff resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48382024-12-06T02:50:21.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 423fc5be-c8c0-4418-b8e7-281373a82bff response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48392024-12-06T02:50:22.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7d0acae0-0e2a-4ae1-b750-002e22d66548 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48402024-12-06T02:50:22.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7d0acae0-0e2a-4ae1-b750-002e22d66548 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48412024-12-06T02:50:22.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7d0acae0-0e2a-4ae1-b750-002e22d66548 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48422024-12-06T02:50:23.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b16e1371-c297-4e16-a862-1c09b39edcbd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48432024-12-06T02:50:23.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b16e1371-c297-4e16-a862-1c09b39edcbd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48442024-12-06T02:50:23.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b16e1371-c297-4e16-a862-1c09b39edcbd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48452024-12-06T02:50:24.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 34e1bff7-0732-4bc8-9e3f-309832cbb680 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48462024-12-06T02:50:24.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 34e1bff7-0732-4bc8-9e3f-309832cbb680 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48472024-12-06T02:50:24.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 34e1bff7-0732-4bc8-9e3f-309832cbb680 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48482024-12-06T02:50:25.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1216 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 5c144531-da61-4f20-8253-ab9859bb1c26 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
48492024-12-06T02:50:25.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d505d45c-4697-4719-9018-a9c811febb90 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48502024-12-06T02:50:25.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d505d45c-4697-4719-9018-a9c811febb90 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48512024-12-06T02:50:25.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d505d45c-4697-4719-9018-a9c811febb90 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48522024-12-06T02:50:26.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 32f19575-3a33-4e05-a44d-e94873cf5566 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48532024-12-06T02:50:26.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 32f19575-3a33-4e05-a44d-e94873cf5566 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48542024-12-06T02:50:26.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 32f19575-3a33-4e05-a44d-e94873cf5566 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48552024-12-06T02:50:27.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 16731abc-b199-4a85-9559-81744f31c57b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48562024-12-06T02:50:27.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 16731abc-b199-4a85-9559-81744f31c57b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48572024-12-06T02:50:27.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 16731abc-b199-4a85-9559-81744f31c57b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48582024-12-06T02:50:28.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e8719db4-8914-4a3f-94ad-e243852302dc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48592024-12-06T02:50:28.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e8719db4-8914-4a3f-94ad-e243852302dc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48602024-12-06T02:50:28.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e8719db4-8914-4a3f-94ad-e243852302dc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48612024-12-06T02:50:29.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d449d99-ff91-4c31-aed7-07646b69d5cd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48622024-12-06T02:50:29.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d449d99-ff91-4c31-aed7-07646b69d5cd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48632024-12-06T02:50:29.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d449d99-ff91-4c31-aed7-07646b69d5cd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
48642024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
48652024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48662024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
48672024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
48682024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48692024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
48702024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48712024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48722024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
48732024-12-06T02:50:30.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48742024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
48752024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48762024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48772024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
48782024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
48792024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48802024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48812024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
48822024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
48832024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48842024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48852024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
48862024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
48872024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
48882024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48892024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48902024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48912024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48922024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48932024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48942024-12-06T02:50:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48952024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48962024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48972024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48982024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48992024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49002024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49012024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49022024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49032024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
49042024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49052024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
49062024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49072024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
49082024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49092024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
49102024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49112024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49122024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49132024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49142024-12-06T02:50:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49152024-12-06T02:50:30.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49162024-12-06T02:50:30.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49172024-12-06T02:50:30.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49182024-12-06T02:50:30.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49192024-12-06T02:50:30.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49202024-12-06T02:50:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49212024-12-06T02:50:30.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49222024-12-06T02:50:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49232024-12-06T02:50:30.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49242024-12-06T02:50:30.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49252024-12-06T02:50:30.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49262024-12-06T02:50:30.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49272024-12-06T02:50:30.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49282024-12-06T02:50:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49292024-12-06T02:50:30.113ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.957ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49302024-12-06T02:50:30.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6178, tv_nsec: 481402839 } })
49312024-12-06T02:50:30.113ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49322024-12-06T02:50:30.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332024-12-06T02:50:30.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-12-06T02:50:30.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6178, tv_nsec: 484095836 } })
49352024-12-06T02:50:30.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49362024-12-06T02:50:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49372024-12-06T02:50:30.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49382024-12-06T02:50:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49392024-12-06T02:50:30.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49402024-12-06T02:50:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49412024-12-06T02:50:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49422024-12-06T02:50:30.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432024-12-06T02:50:30.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.394433ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
49442024-12-06T02:50:30.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49452024-12-06T02:50:30.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49462024-12-06T02:50:30.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49472024-12-06T02:50:30.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49482024-12-06T02:50:30.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49492024-12-06T02:50:30.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49502024-12-06T02:50:30.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49512024-12-06T02:50:30.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.471785ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49522024-12-06T02:50:30.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532024-12-06T02:50:30.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49542024-12-06T02:50:30.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49552024-12-06T02:50:30.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49562024-12-06T02:50:30.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49572024-12-06T02:50:30.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49582024-12-06T02:50:30.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49592024-12-06T02:50:30.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49602024-12-06T02:50:30.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49612024-12-06T02:50:30.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49622024-12-06T02:50:30.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49632024-12-06T02:50:30.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49642024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49652024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49662024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49672024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49682024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
49692024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49702024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49712024-12-06T02:50:30.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49722024-12-06T02:50:30.147ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6178, tv_nsec: 514933406 } })
49732024-12-06T02:50:30.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-12-06T02:50:30.147ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
49752024-12-06T02:50:30.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49762024-12-06T02:50:30.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49772024-12-06T02:50:30.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49782024-12-06T02:50:30.164ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 64.339528ms iteration = 21 status = {"physical_disks_added":0}
49792024-12-06T02:50:30.168ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49802024-12-06T02:50:30.168ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49812024-12-06T02:50:30.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49822024-12-06T02:50:30.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49832024-12-06T02:50:30.168ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
49842024-12-06T02:50:30.168ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.500236ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
49852024-12-06T02:50:30.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.974187ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
49862024-12-06T02:50:30.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49872024-12-06T02:50:30.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49882024-12-06T02:50:30.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49892024-12-06T02:50:30.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.714933ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49902024-12-06T02:50:30.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49912024-12-06T02:50:30.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49922024-12-06T02:50:30.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49932024-12-06T02:50:30.179ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49942024-12-06T02:50:30.179ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.188121ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49952024-12-06T02:50:30.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49962024-12-06T02:50:30.183ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49972024-12-06T02:50:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49982024-12-06T02:50:30.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49992024-12-06T02:50:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50002024-12-06T02:50:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
50012024-12-06T02:50:30.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50022024-12-06T02:50:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50032024-12-06T02:50:30.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.065218ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50042024-12-06T02:50:30.187ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.237882ms iteration = 18 status = 0
50052024-12-06T02:50:30.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.202292ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50062024-12-06T02:50:30.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50072024-12-06T02:50:30.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50082024-12-06T02:50:30.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50092024-12-06T02:50:30.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50102024-12-06T02:50:30.208ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50112024-12-06T02:50:30.208ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50122024-12-06T02:50:30.208ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9840cff5-2290-4da7-971a-3ad4263363e8", "content-length": "26", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50132024-12-06T02:50:30.208ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50142024-12-06T02:50:30.209ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50152024-12-06T02:50:30.209ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50162024-12-06T02:50:30.209ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ae109b2-305f-4033-b14d-f354c0c0f071", "content-length": "26", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50172024-12-06T02:50:30.209ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50182024-12-06T02:50:30.210ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50192024-12-06T02:50:30.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50202024-12-06T02:50:30.228ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50212024-12-06T02:50:30.228ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50222024-12-06T02:50:30.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50232024-12-06T02:50:30.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50242024-12-06T02:50:30.251ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
50252024-12-06T02:50:30.251ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50262024-12-06T02:50:30.252ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21519fe7-7724-474c-bea9-e752720383a8", "content-length": "26", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50272024-12-06T02:50:30.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50282024-12-06T02:50:30.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
50292024-12-06T02:50:30.271ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50302024-12-06T02:50:30.271ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50312024-12-06T02:50:30.271ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 171.264572ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50322024-12-06T02:50:30.339ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 239.43958ms iteration = 18 status = {}
50332024-12-06T02:50:30.349ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50342024-12-06T02:50:30.349ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50352024-12-06T02:50:30.349ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "809cd7b5-002e-45de-96af-0c5afd4ec7fd", "content-length": "372", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50362024-12-06T02:50:30.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50372024-12-06T02:50:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50382024-12-06T02:50:30.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 366f4cb5-9969-49d5-9a70-045892a333ba roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
50392024-12-06T02:50:30.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 366f4cb5-9969-49d5-9a70-045892a333ba resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
50402024-12-06T02:50:30.428ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50412024-12-06T02:50:30.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cf2f550-9260-481e-8875-5db65505ec5a", "content-length": "691", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50422024-12-06T02:50:30.429ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50432024-12-06T02:50:30.429ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50442024-12-06T02:50:30.429ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50452024-12-06T02:50:30.430ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50462024-12-06T02:50:30.430ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "480101ff-21bf-4493-811e-951b574e5a40", "content-length": "1", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50472024-12-06T02:50:30.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 330.15263ms iteration = 18 status = {}
50482024-12-06T02:50:30.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 366f4cb5-9969-49d5-9a70-045892a333ba response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
50492024-12-06T02:50:30.432ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50502024-12-06T02:50:30.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50512024-12-06T02:50:30.434ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 334.198866ms iteration = 18 status = null
50522024-12-06T02:50:30.469ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50532024-12-06T02:50:30.469ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50542024-12-06T02:50:30.470ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "adac1f43-9283-4e0f-9147-9b9f28269021", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50552024-12-06T02:50:30.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50562024-12-06T02:50:30.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50572024-12-06T02:50:30.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50582024-12-06T02:50:30.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50592024-12-06T02:50:30.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50602024-12-06T02:50:30.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50612024-12-06T02:50:30.473ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
50622024-12-06T02:50:30.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50632024-12-06T02:50:30.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50642024-12-06T02:50:30.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50652024-12-06T02:50:30.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50662024-12-06T02:50:30.479ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50672024-12-06T02:50:30.479ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50682024-12-06T02:50:30.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4f5fff6f-cf6c-4231-8c11-2e60ede40c3d", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50692024-12-06T02:50:30.480ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 380.486028ms iteration = 19 status = {}
50702024-12-06T02:50:30.482ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50712024-12-06T02:50:30.483ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "56b3d692-d2a0-4c38-9184-57b1a3cb11ad", "content-length": "134", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50722024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50732024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
50742024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50752024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50762024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50772024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50782024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50792024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50802024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50812024-12-06T02:50:30.483ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50822024-12-06T02:50:30.484ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
50832024-12-06T02:50:30.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50842024-12-06T02:50:30.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50852024-12-06T02:50:30.486ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50862024-12-06T02:50:30.486ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffdd0d60-a9d3-456c-a0bd-8ebe9a2669b2", "content-length": "2", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50872024-12-06T02:50:30.486ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50882024-12-06T02:50:30.486ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9184673e-089a-41a9-a254-a1d5873cb34e", "content-length": "52", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50892024-12-06T02:50:30.486ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
50902024-12-06T02:50:30.486ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50912024-12-06T02:50:30.583ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4dc79593-2573-4414-9efb-d06e9941b5ce", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50922024-12-06T02:50:30.583ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
50932024-12-06T02:50:30.583ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50942024-12-06T02:50:30.584ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "44edf517-9ed2-414a-a2bf-d27e044a8050", "content-length": "682", "date": "Fri, 06 Dec 2024 02:50:30 GMT"} })
50952024-12-06T02:50:30.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50962024-12-06T02:50:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50972024-12-06T02:50:30.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50982024-12-06T02:50:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50992024-12-06T02:50:30.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51002024-12-06T02:50:30.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51012024-12-06T02:50:30.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51022024-12-06T02:50:30.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51032024-12-06T02:50:30.602ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.67258ms iteration = 18 status = {}
51042024-12-06T02:50:31.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6e60fe78-7168-4092-8e5b-42604feb4539 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51052024-12-06T02:50:31.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6e60fe78-7168-4092-8e5b-42604feb4539 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51062024-12-06T02:50:31.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6e60fe78-7168-4092-8e5b-42604feb4539 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51072024-12-06T02:50:31.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 0da33a92-89e8-4680-90bd-edbb8a5e4d4a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51082024-12-06T02:50:31.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 0da33a92-89e8-4680-90bd-edbb8a5e4d4a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51092024-12-06T02:50:31.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 0da33a92-89e8-4680-90bd-edbb8a5e4d4a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51102024-12-06T02:50:32.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6de9caaf-3c40-4ce4-84ed-c7cb2c898f85 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51112024-12-06T02:50:32.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6de9caaf-3c40-4ce4-84ed-c7cb2c898f85 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51122024-12-06T02:50:32.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6de9caaf-3c40-4ce4-84ed-c7cb2c898f85 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51132024-12-06T02:50:33.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f0f1a34e-26ef-4a5a-9e0d-96098376ca17 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51142024-12-06T02:50:33.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f0f1a34e-26ef-4a5a-9e0d-96098376ca17 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51152024-12-06T02:50:33.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f0f1a34e-26ef-4a5a-9e0d-96098376ca17 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51162024-12-06T02:50:34.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 71d2bb59-d0eb-4564-b381-997c7ab2a863 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51172024-12-06T02:50:34.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 71d2bb59-d0eb-4564-b381-997c7ab2a863 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51182024-12-06T02:50:34.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 71d2bb59-d0eb-4564-b381-997c7ab2a863 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51192024-12-06T02:50:35.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1401 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 2fea95e2-355d-4adf-8ebd-65b31f440d0a response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
51202024-12-06T02:50:35.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 15230943-1bbd-4f52-834f-4e82e1b209fb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51212024-12-06T02:50:35.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 15230943-1bbd-4f52-834f-4e82e1b209fb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51222024-12-06T02:50:35.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 15230943-1bbd-4f52-834f-4e82e1b209fb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51232024-12-06T02:50:36.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f6bbc87f-2ab8-41f1-8c34-110662a33958 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51242024-12-06T02:50:36.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f6bbc87f-2ab8-41f1-8c34-110662a33958 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51252024-12-06T02:50:36.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f6bbc87f-2ab8-41f1-8c34-110662a33958 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51262024-12-06T02:50:37.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3566db74-2da2-4d8f-8672-2f5dffdb095f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51272024-12-06T02:50:37.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3566db74-2da2-4d8f-8672-2f5dffdb095f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51282024-12-06T02:50:37.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3566db74-2da2-4d8f-8672-2f5dffdb095f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51292024-12-06T02:50:38.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e4461d6b-bbd1-4261-8c44-12cb4810b5cb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51302024-12-06T02:50:38.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e4461d6b-bbd1-4261-8c44-12cb4810b5cb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51312024-12-06T02:50:38.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e4461d6b-bbd1-4261-8c44-12cb4810b5cb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51322024-12-06T02:50:39.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e134f4f2-4f06-418c-8f72-db1cda4d1f7a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51332024-12-06T02:50:39.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e134f4f2-4f06-418c-8f72-db1cda4d1f7a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51342024-12-06T02:50:39.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e134f4f2-4f06-418c-8f72-db1cda4d1f7a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51352024-12-06T02:50:40.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
51362024-12-06T02:50:40.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51372024-12-06T02:50:40.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
51382024-12-06T02:50:40.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51392024-12-06T02:50:40.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51402024-12-06T02:50:40.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51412024-12-06T02:50:40.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422024-12-06T02:50:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51432024-12-06T02:50:40.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51442024-12-06T02:50:40.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51452024-12-06T02:50:40.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51462024-12-06T02:50:40.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51472024-12-06T02:50:40.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51482024-12-06T02:50:40.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
51492024-12-06T02:50:40.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51502024-12-06T02:50:40.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51512024-12-06T02:50:40.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
51522024-12-06T02:50:40.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.382399ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
51532024-12-06T02:50:40.131ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51542024-12-06T02:50:40.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51552024-12-06T02:50:40.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.52694ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51562024-12-06T02:50:40.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bfb5badc-da64-4091-886c-e257d6d4b682 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51572024-12-06T02:50:40.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bfb5badc-da64-4091-886c-e257d6d4b682 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51582024-12-06T02:50:40.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bfb5badc-da64-4091-886c-e257d6d4b682 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51592024-12-06T02:50:41.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90aac09e-ab59-4e64-8e32-e9804b7b6216 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51602024-12-06T02:50:41.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90aac09e-ab59-4e64-8e32-e9804b7b6216 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51612024-12-06T02:50:41.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 90aac09e-ab59-4e64-8e32-e9804b7b6216 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51622024-12-06T02:50:42.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4650780f-141b-4313-b430-ce1db6cbfcd2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51632024-12-06T02:50:42.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4650780f-141b-4313-b430-ce1db6cbfcd2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51642024-12-06T02:50:42.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4650780f-141b-4313-b430-ce1db6cbfcd2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51652024-12-06T02:50:43.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afa58957-a299-4a67-994d-7c07d6a237d7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51662024-12-06T02:50:43.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afa58957-a299-4a67-994d-7c07d6a237d7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51672024-12-06T02:50:43.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afa58957-a299-4a67-994d-7c07d6a237d7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51682024-12-06T02:50:44.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed8467ce-bd89-4cde-8865-47194c6993ab roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51692024-12-06T02:50:44.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed8467ce-bd89-4cde-8865-47194c6993ab resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51702024-12-06T02:50:44.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ed8467ce-bd89-4cde-8865-47194c6993ab response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51712024-12-06T02:50:45.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = e0c8d2e5-d5ab-44a5-953b-d5690237eb6a response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
51722024-12-06T02:50:45.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 156102cb-886c-4d3a-8de0-c37e276a8221 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51732024-12-06T02:50:45.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 156102cb-886c-4d3a-8de0-c37e276a8221 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51742024-12-06T02:50:45.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 156102cb-886c-4d3a-8de0-c37e276a8221 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51752024-12-06T02:50:46.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 520dccf2-e792-4cba-95be-28907ae61bc0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51762024-12-06T02:50:46.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 520dccf2-e792-4cba-95be-28907ae61bc0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51772024-12-06T02:50:46.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 520dccf2-e792-4cba-95be-28907ae61bc0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51782024-12-06T02:50:47.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e97626ec-370b-41ac-b028-b3d9365225d3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51792024-12-06T02:50:47.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e97626ec-370b-41ac-b028-b3d9365225d3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51802024-12-06T02:50:47.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e97626ec-370b-41ac-b028-b3d9365225d3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51812024-12-06T02:50:48.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a3d76d2-eef6-498a-8be7-c7f5b954433e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51822024-12-06T02:50:48.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a3d76d2-eef6-498a-8be7-c7f5b954433e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51832024-12-06T02:50:48.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a3d76d2-eef6-498a-8be7-c7f5b954433e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51842024-12-06T02:50:49.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 353cff04-f5ec-4c93-a6bf-fac51813e774 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51852024-12-06T02:50:49.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 353cff04-f5ec-4c93-a6bf-fac51813e774 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51862024-12-06T02:50:49.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 353cff04-f5ec-4c93-a6bf-fac51813e774 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
51872024-12-06T02:50:50.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
51882024-12-06T02:50:50.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
51892024-12-06T02:50:50.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51902024-12-06T02:50:50.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51912024-12-06T02:50:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51922024-12-06T02:50:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51932024-12-06T02:50:50.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51942024-12-06T02:50:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51952024-12-06T02:50:50.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51962024-12-06T02:50:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51972024-12-06T02:50:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51982024-12-06T02:50:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51992024-12-06T02:50:50.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52002024-12-06T02:50:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52012024-12-06T02:50:50.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52022024-12-06T02:50:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
52032024-12-06T02:50:50.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52042024-12-06T02:50:50.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52052024-12-06T02:50:50.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
52062024-12-06T02:50:50.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.393921ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
52072024-12-06T02:50:50.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.240107ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52082024-12-06T02:50:50.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b90d1d42-272a-42ef-81aa-b3a8930230ad roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52092024-12-06T02:50:50.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b90d1d42-272a-42ef-81aa-b3a8930230ad resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52102024-12-06T02:50:50.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b90d1d42-272a-42ef-81aa-b3a8930230ad response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52112024-12-06T02:50:51.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3e5fa9d5-9ddb-43f2-878a-dbc7e3b8165c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52122024-12-06T02:50:51.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3e5fa9d5-9ddb-43f2-878a-dbc7e3b8165c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52132024-12-06T02:50:51.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3e5fa9d5-9ddb-43f2-878a-dbc7e3b8165c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52142024-12-06T02:50:52.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 39663a8e-9123-4176-8365-b1584ae8497e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52152024-12-06T02:50:52.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 39663a8e-9123-4176-8365-b1584ae8497e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52162024-12-06T02:50:52.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 39663a8e-9123-4176-8365-b1584ae8497e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52172024-12-06T02:50:53.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0f0b84e-0ff9-48bf-a9be-3525fdfe5620 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52182024-12-06T02:50:53.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0f0b84e-0ff9-48bf-a9be-3525fdfe5620 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52192024-12-06T02:50:53.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0f0b84e-0ff9-48bf-a9be-3525fdfe5620 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52202024-12-06T02:50:54.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6320d280-e8b3-4cef-9bcd-0639950fa4d0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52212024-12-06T02:50:54.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6320d280-e8b3-4cef-9bcd-0639950fa4d0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52222024-12-06T02:50:54.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6320d280-e8b3-4cef-9bcd-0639950fa4d0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52232024-12-06T02:50:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1247 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 9a41a85f-cba0-4dd5-9212-321fb503847d response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
52242024-12-06T02:50:55.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50734368-7646-4f0c-834d-a436bd32cfcd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52252024-12-06T02:50:55.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50734368-7646-4f0c-834d-a436bd32cfcd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52262024-12-06T02:50:55.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50734368-7646-4f0c-834d-a436bd32cfcd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52272024-12-06T02:50:56.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 16df2873-76d6-4970-a1f6-b8c860ca1a3b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52282024-12-06T02:50:56.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 16df2873-76d6-4970-a1f6-b8c860ca1a3b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52292024-12-06T02:50:56.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 16df2873-76d6-4970-a1f6-b8c860ca1a3b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52302024-12-06T02:50:58.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cbb6d3eb-e661-41a3-be5d-0f2f9ae7454b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52312024-12-06T02:50:58.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cbb6d3eb-e661-41a3-be5d-0f2f9ae7454b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52322024-12-06T02:50:58.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cbb6d3eb-e661-41a3-be5d-0f2f9ae7454b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52332024-12-06T02:50:59.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d869df8c-b630-420f-a511-eca4a8f7b36b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52342024-12-06T02:50:59.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d869df8c-b630-420f-a511-eca4a8f7b36b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52352024-12-06T02:50:59.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d869df8c-b630-420f-a511-eca4a8f7b36b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52362024-12-06T02:51:00.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7e7902f7-b961-45c1-a12e-7d95b3bdf81d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52372024-12-06T02:51:00.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7e7902f7-b961-45c1-a12e-7d95b3bdf81d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52382024-12-06T02:51:00.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7e7902f7-b961-45c1-a12e-7d95b3bdf81d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
52392024-12-06T02:51:00.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
52402024-12-06T02:51:00.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52412024-12-06T02:51:00.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
52422024-12-06T02:51:00.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
52432024-12-06T02:51:00.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52442024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52452024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
52462024-12-06T02:51:00.101ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:41:00.100972938 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52472024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52482024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
52492024-12-06T02:51:00.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52502024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52512024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
52522024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52532024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
52542024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
52552024-12-06T02:51:00.101ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
52562024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
52572024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.92\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
52582024-12-06T02:51:00.101ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52592024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
52602024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52612024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
52622024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52632024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
52642024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
52652024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
52662024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52672024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52682024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
52692024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52702024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52712024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
52722024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
52732024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52742024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
52752024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52762024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
52772024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52782024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52792024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52802024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
52812024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52822024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
52832024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52842024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
52852024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
52862024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52872024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
52882024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52892024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52902024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
52912024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
52922024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52932024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
52942024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52952024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52962024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52972024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
52982024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
52992024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53002024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
53012024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53022024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53032024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
53042024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53052024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53062024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53072024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53082024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53092024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53102024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53112024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53122024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53132024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53142024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53152024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53162024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53172024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53182024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53192024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53202024-12-06T02:51:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53212024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53222024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53232024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53242024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53252024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53262024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53272024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53282024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53292024-12-06T02:51:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6208, tv_nsec: 469946430 } })
53302024-12-06T02:51:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6208, tv_nsec: 469981831 } })
53312024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53322024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53332024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53342024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53352024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53362024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53372024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53382024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53392024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
53402024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.440241ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
53412024-12-06T02:51:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.708019ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53422024-12-06T02:51:00.117ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:41:00.100972938 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53432024-12-06T02:51:00.117ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.178382ms iteration = 10 status = {"expiration":"2024-12-06T02:41:00.100972938Z","pruned":[]}
53442024-12-06T02:51:00.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6208, tv_nsec: 488383637 } })
53452024-12-06T02:51:00.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53462024-12-06T02:51:00.121ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.998451ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53472024-12-06T02:51:00.122ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53482024-12-06T02:51:00.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53492024-12-06T02:51:00.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53502024-12-06T02:51:00.124ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6208, tv_nsec: 492449043 } })
53512024-12-06T02:51:00.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53522024-12-06T02:51:00.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53532024-12-06T02:51:00.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53542024-12-06T02:51:00.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53552024-12-06T02:51:00.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53562024-12-06T02:51:00.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53572024-12-06T02:51:00.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53582024-12-06T02:51:00.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53592024-12-06T02:51:00.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53602024-12-06T02:51:00.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53612024-12-06T02:51:00.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53622024-12-06T02:51:00.130ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53632024-12-06T02:51:00.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53642024-12-06T02:51:00.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53652024-12-06T02:51:00.132ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53662024-12-06T02:51:00.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53672024-12-06T02:51:00.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53682024-12-06T02:51:00.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53692024-12-06T02:51:00.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53702024-12-06T02:51:00.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712024-12-06T02:51:00.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53722024-12-06T02:51:00.136ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53732024-12-06T02:51:00.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53742024-12-06T02:51:00.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53752024-12-06T02:51:00.137ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53762024-12-06T02:51:00.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53772024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53782024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53792024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53802024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53812024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 37.998066ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
53822024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53832024-12-06T02:51:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53842024-12-06T02:51:00.157ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6208, tv_nsec: 525680102 } })
53852024-12-06T02:51:00.158ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
53862024-12-06T02:51:00.164ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53872024-12-06T02:51:00.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53882024-12-06T02:51:00.200ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53892024-12-06T02:51:00.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53902024-12-06T02:51:00.203ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53912024-12-06T02:51:00.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53922024-12-06T02:51:00.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932024-12-06T02:51:00.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53942024-12-06T02:51:00.210ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-12-06T02:51:00.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53962024-12-06T02:51:00.213ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53972024-12-06T02:51:00.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53982024-12-06T02:51:00.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53992024-12-06T02:51:00.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54002024-12-06T02:51:00.222ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54012024-12-06T02:51:00.222ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.491835ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54022024-12-06T02:51:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54032024-12-06T02:51:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54042024-12-06T02:51:00.222ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54052024-12-06T02:51:00.222ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54062024-12-06T02:51:00.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54072024-12-06T02:51:00.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54082024-12-06T02:51:00.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54092024-12-06T02:51:00.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54102024-12-06T02:51:00.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54112024-12-06T02:51:00.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54122024-12-06T02:51:00.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 136.492619ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
54132024-12-06T02:51:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54142024-12-06T02:51:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54152024-12-06T02:51:00.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162024-12-06T02:51:00.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54172024-12-06T02:51:00.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54182024-12-06T02:51:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54192024-12-06T02:51:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54202024-12-06T02:51:00.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54212024-12-06T02:51:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54222024-12-06T02:51:00.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232024-12-06T02:51:00.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 141.152112ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
54242024-12-06T02:51:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 142.206511ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54252024-12-06T02:51:00.244ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54262024-12-06T02:51:00.244ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54272024-12-06T02:51:00.244ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 142.858601ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54282024-12-06T02:51:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54292024-12-06T02:51:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54302024-12-06T02:51:00.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54312024-12-06T02:51:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54322024-12-06T02:51:00.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332024-12-06T02:51:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54342024-12-06T02:51:00.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54352024-12-06T02:51:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54362024-12-06T02:51:00.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54372024-12-06T02:51:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54382024-12-06T02:51:00.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392024-12-06T02:51:00.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54402024-12-06T02:51:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54412024-12-06T02:51:00.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54422024-12-06T02:51:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54432024-12-06T02:51:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
54442024-12-06T02:51:00.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54452024-12-06T02:51:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54462024-12-06T02:51:00.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54472024-12-06T02:51:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54482024-12-06T02:51:00.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54492024-12-06T02:51:00.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54502024-12-06T02:51:00.279ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54512024-12-06T02:51:00.279ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54522024-12-06T02:51:00.279ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54532024-12-06T02:51:00.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54542024-12-06T02:51:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54552024-12-06T02:51:00.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54562024-12-06T02:51:00.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54572024-12-06T02:51:00.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54582024-12-06T02:51:00.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-12-06T02:51:00.298ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54602024-12-06T02:51:00.298ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54612024-12-06T02:51:00.298ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 197.811341ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54622024-12-06T02:51:00.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54632024-12-06T02:51:00.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54642024-12-06T02:51:00.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54652024-12-06T02:51:00.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54662024-12-06T02:51:00.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54672024-12-06T02:51:00.307ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54682024-12-06T02:51:00.307ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54692024-12-06T02:51:00.307ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54702024-12-06T02:51:00.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54712024-12-06T02:51:00.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54722024-12-06T02:51:00.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54732024-12-06T02:51:00.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54742024-12-06T02:51:00.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54752024-12-06T02:51:00.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54762024-12-06T02:51:00.316ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54772024-12-06T02:51:00.316ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54782024-12-06T02:51:00.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54792024-12-06T02:51:00.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54802024-12-06T02:51:00.340ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54812024-12-06T02:51:00.340ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54822024-12-06T02:51:00.340ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "263bce41-3ba7-4049-8a86-f0c8a019181a", "content-length": "26", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
54832024-12-06T02:51:00.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54842024-12-06T02:51:00.343ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54852024-12-06T02:51:00.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54862024-12-06T02:51:00.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54872024-12-06T02:51:00.377ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54882024-12-06T02:51:00.377ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54892024-12-06T02:51:00.377ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "628a81da-b1f2-41c8-9f69-f69503e7ed76", "content-length": "26", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
54902024-12-06T02:51:00.377ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54912024-12-06T02:51:00.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54922024-12-06T02:51:00.379ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54932024-12-06T02:51:00.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
54942024-12-06T02:51:00.392ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54952024-12-06T02:51:00.392ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b7324b0-a117-489a-9c4a-deaf9e636b2a", "content-length": "26", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
54962024-12-06T02:51:00.392ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54972024-12-06T02:51:00.393ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
54982024-12-06T02:51:00.462ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54992024-12-06T02:51:00.462ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f07aa368-51e4-4df6-ad51-256f3d6e50c0", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55002024-12-06T02:51:00.462ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55012024-12-06T02:51:00.464ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a5508f67-3b00-4f24-b2fa-64fa22f3898c", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55022024-12-06T02:51:00.464ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55032024-12-06T02:51:00.465ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55042024-12-06T02:51:00.466ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 364.891093ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55052024-12-06T02:51:00.522ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55062024-12-06T02:51:00.522ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55072024-12-06T02:51:00.522ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d3cc71-b530-4278-9573-d95a3974e7e5", "content-length": "372", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
55082024-12-06T02:51:00.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55092024-12-06T02:51:00.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55102024-12-06T02:51:00.525ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 424.497085ms iteration = 5 status = {"nsuccess":5}
55112024-12-06T02:51:00.527ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55122024-12-06T02:51:00.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55132024-12-06T02:51:00.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55142024-12-06T02:51:00.539ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
55152024-12-06T02:51:00.539ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 438.604858ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
55162024-12-06T02:51:00.542ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.779699ms iteration = 19 status = {}
55172024-12-06T02:51:00.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 453.175814ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55182024-12-06T02:51:00.558ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55192024-12-06T02:51:00.559ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8273784b-919a-4877-b487-2c0d96104bf0", "content-length": "1", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
55202024-12-06T02:51:00.560ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55212024-12-06T02:51:00.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55222024-12-06T02:51:00.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 461.032619ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55232024-12-06T02:51:00.565ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.378304ms iteration = 19 status = null
55242024-12-06T02:51:00.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55252024-12-06T02:51:00.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55262024-12-06T02:51:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55272024-12-06T02:51:00.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55282024-12-06T02:51:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55292024-12-06T02:51:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55302024-12-06T02:51:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55312024-12-06T02:51:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
55322024-12-06T02:51:00.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55332024-12-06T02:51:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55342024-12-06T02:51:00.577ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55352024-12-06T02:51:00.577ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55362024-12-06T02:51:00.577ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 476.330676ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55372024-12-06T02:51:00.578ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 477.226831ms iteration = 19 status = 0
55382024-12-06T02:51:00.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55392024-12-06T02:51:00.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 479.759773ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55402024-12-06T02:51:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55412024-12-06T02:51:00.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55422024-12-06T02:51:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55432024-12-06T02:51:00.590ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55442024-12-06T02:51:00.590ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55452024-12-06T02:51:00.590ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7150a849-0e3c-44e7-a576-735aba3b54c8", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
55462024-12-06T02:51:00.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55472024-12-06T02:51:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55482024-12-06T02:51:00.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55492024-12-06T02:51:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55502024-12-06T02:51:00.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55512024-12-06T02:51:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55522024-12-06T02:51:00.599ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55532024-12-06T02:51:00.599ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55542024-12-06T02:51:00.600ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6ae6f4dc-2d82-44ce-b71e-3323fbdf96a9", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
55552024-12-06T02:51:00.602ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 501.764282ms iteration = 20 status = {}
55562024-12-06T02:51:00.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55572024-12-06T02:51:00.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55582024-12-06T02:51:00.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55592024-12-06T02:51:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55602024-12-06T02:51:00.608ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55612024-12-06T02:51:00.608ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
55622024-12-06T02:51:00.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55632024-12-06T02:51:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55642024-12-06T02:51:00.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-12-06T02:51:00.612ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55662024-12-06T02:51:00.612ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1467f7b1-6781-4eca-aa07-54a450742a77", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55672024-12-06T02:51:00.612ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55682024-12-06T02:51:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55692024-12-06T02:51:00.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55702024-12-06T02:51:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55712024-12-06T02:51:00.614ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "be2435d2-f591-4f25-8d4a-5fab83ff9c37", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55722024-12-06T02:51:00.614ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55732024-12-06T02:51:00.618ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c13201be-318e-434d-82a8-ff33a71947aa", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55742024-12-06T02:51:00.618ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55752024-12-06T02:51:00.618ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
55762024-12-06T02:51:00.618ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55772024-12-06T02:51:00.618ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
55782024-12-06T02:51:00.618ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 517.670647ms iteration = 11 status = {"generation":2}
55792024-12-06T02:51:00.619ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55802024-12-06T02:51:00.619ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55812024-12-06T02:51:00.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55822024-12-06T02:51:00.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55832024-12-06T02:51:00.620ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55842024-12-06T02:51:00.620ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 518.959424ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55852024-12-06T02:51:00.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55862024-12-06T02:51:00.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55872024-12-06T02:51:00.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55882024-12-06T02:51:00.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55892024-12-06T02:51:00.628ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55902024-12-06T02:51:00.628ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55912024-12-06T02:51:00.628ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
55922024-12-06T02:51:00.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 527.480207ms iteration = 11 status = {"generation":1}
55932024-12-06T02:51:00.632ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55942024-12-06T02:51:00.632ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 531.257265ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55952024-12-06T02:51:00.639ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
55962024-12-06T02:51:00.639ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 538.237094ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55972024-12-06T02:51:00.643ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 542.530187ms iteration = 22 status = {"physical_disks_added":0}
55982024-12-06T02:51:00.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55992024-12-06T02:51:00.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56002024-12-06T02:51:00.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56012024-12-06T02:51:00.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56022024-12-06T02:51:00.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56032024-12-06T02:51:00.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56042024-12-06T02:51:00.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56052024-12-06T02:51:00.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56062024-12-06T02:51:00.652ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
56072024-12-06T02:51:00.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56082024-12-06T02:51:00.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56092024-12-06T02:51:00.662ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56102024-12-06T02:51:00.662ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7930ca0d-ab2c-4d8a-ae3b-41b9c9fbe6cb", "content-length": "134", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
56112024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56122024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
56132024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56142024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56152024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56162024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56172024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56182024-12-06T02:51:00.662ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56192024-12-06T02:51:00.663ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56202024-12-06T02:51:00.663ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56212024-12-06T02:51:00.663ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
56222024-12-06T02:51:00.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56232024-12-06T02:51:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56242024-12-06T02:51:00.665ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56252024-12-06T02:51:00.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d41c322d-ec5f-43d7-a101-f6f23179690f", "content-length": "2", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
56262024-12-06T02:51:00.665ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56272024-12-06T02:51:00.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb319efa-d00a-48f8-9d4e-bec8443f0c26", "content-length": "52", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
56282024-12-06T02:51:00.665ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
56292024-12-06T02:51:00.665ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56302024-12-06T02:51:00.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56312024-12-06T02:51:00.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56322024-12-06T02:51:00.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56332024-12-06T02:51:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56342024-12-06T02:51:00.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56352024-12-06T02:51:00.764ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3ce3a78-fac3-4941-85fa-914822437b3f", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
56362024-12-06T02:51:00.764ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
56372024-12-06T02:51:00.764ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56382024-12-06T02:51:00.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f47290e-dd8a-4b1a-9bf5-51eb0d20a203", "content-length": "682", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
56392024-12-06T02:51:00.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402024-12-06T02:51:00.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412024-12-06T02:51:00.769ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e6b3900-cc57-4193-b75a-9738731bbe50", "content-length": "691", "date": "Fri, 06 Dec 2024 02:51:00 GMT"} })
56422024-12-06T02:51:00.769ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56432024-12-06T02:51:00.769ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56442024-12-06T02:51:00.769ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56452024-12-06T02:51:00.770ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 670.116451ms iteration = 19 status = {}
56462024-12-06T02:51:00.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56472024-12-06T02:51:00.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56482024-12-06T02:51:00.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56492024-12-06T02:51:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56502024-12-06T02:51:00.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56512024-12-06T02:51:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56522024-12-06T02:51:00.786ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 685.224693ms iteration = 19 status = {}
56532024-12-06T02:51:01.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ea28fcb-dd1a-4de0-abe6-d3432ac92f08 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56542024-12-06T02:51:01.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ea28fcb-dd1a-4de0-abe6-d3432ac92f08 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56552024-12-06T02:51:01.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6ea28fcb-dd1a-4de0-abe6-d3432ac92f08 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56562024-12-06T02:51:01.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = f822d6d8-fe37-4099-8ee9-d3c736fc0a69 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
56572024-12-06T02:51:01.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = f822d6d8-fe37-4099-8ee9-d3c736fc0a69 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56582024-12-06T02:51:01.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = f822d6d8-fe37-4099-8ee9-d3c736fc0a69 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
56592024-12-06T02:51:02.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 023d69e0-83ab-4f54-be84-d96c51458649 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56602024-12-06T02:51:02.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 023d69e0-83ab-4f54-be84-d96c51458649 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56612024-12-06T02:51:02.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 023d69e0-83ab-4f54-be84-d96c51458649 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56622024-12-06T02:51:03.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a10156ee-f36b-4f3a-8bc4-1302ee86323e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56632024-12-06T02:51:03.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a10156ee-f36b-4f3a-8bc4-1302ee86323e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56642024-12-06T02:51:03.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a10156ee-f36b-4f3a-8bc4-1302ee86323e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56652024-12-06T02:51:04.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d18753c9-68be-4aa0-839d-9e997b20b2b6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56662024-12-06T02:51:04.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d18753c9-68be-4aa0-839d-9e997b20b2b6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56672024-12-06T02:51:04.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d18753c9-68be-4aa0-839d-9e997b20b2b6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56682024-12-06T02:51:05.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1259 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 5e8dbd50-d2f6-4a5b-bbf3-e22d8677c91f response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
56692024-12-06T02:51:05.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4b60c942-fc1c-4235-8bc3-90cfbf7b7cbe roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56702024-12-06T02:51:05.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4b60c942-fc1c-4235-8bc3-90cfbf7b7cbe resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56712024-12-06T02:51:05.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4b60c942-fc1c-4235-8bc3-90cfbf7b7cbe response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56722024-12-06T02:51:06.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 156957fd-10c0-49cf-abdf-135cb10b708d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56732024-12-06T02:51:06.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 156957fd-10c0-49cf-abdf-135cb10b708d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56742024-12-06T02:51:06.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 156957fd-10c0-49cf-abdf-135cb10b708d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56752024-12-06T02:51:07.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d2cb9a08-4791-4590-8763-a5f96375743b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56762024-12-06T02:51:07.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d2cb9a08-4791-4590-8763-a5f96375743b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56772024-12-06T02:51:07.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d2cb9a08-4791-4590-8763-a5f96375743b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56782024-12-06T02:51:08.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 988fd2d6-7245-4e55-8d78-7f3505731750 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56792024-12-06T02:51:08.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 988fd2d6-7245-4e55-8d78-7f3505731750 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56802024-12-06T02:51:08.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 988fd2d6-7245-4e55-8d78-7f3505731750 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56812024-12-06T02:51:09.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb65531d-1719-4b2d-83b4-091abadf75f0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56822024-12-06T02:51:09.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb65531d-1719-4b2d-83b4-091abadf75f0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56832024-12-06T02:51:09.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb65531d-1719-4b2d-83b4-091abadf75f0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
56842024-12-06T02:51:10.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
56852024-12-06T02:51:10.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56862024-12-06T02:51:10.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
56872024-12-06T02:51:10.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56882024-12-06T02:51:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56892024-12-06T02:51:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56902024-12-06T02:51:10.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56912024-12-06T02:51:10.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56922024-12-06T02:51:10.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56932024-12-06T02:51:10.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56942024-12-06T02:51:10.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56952024-12-06T02:51:10.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56962024-12-06T02:51:10.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56972024-12-06T02:51:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
56982024-12-06T02:51:10.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56992024-12-06T02:51:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57002024-12-06T02:51:10.118ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
57012024-12-06T02:51:10.118ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.004614ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
57022024-12-06T02:51:10.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57032024-12-06T02:51:10.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57042024-12-06T02:51:10.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.044947ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57052024-12-06T02:51:10.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 63e2e00c-1149-44cb-93bb-6e899f52e284 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57062024-12-06T02:51:10.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 63e2e00c-1149-44cb-93bb-6e899f52e284 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57072024-12-06T02:51:10.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 63e2e00c-1149-44cb-93bb-6e899f52e284 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57082024-12-06T02:51:11.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dd5babd7-ca5d-4ee6-ae03-07cfeedf2bcf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57092024-12-06T02:51:11.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dd5babd7-ca5d-4ee6-ae03-07cfeedf2bcf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57102024-12-06T02:51:11.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dd5babd7-ca5d-4ee6-ae03-07cfeedf2bcf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57112024-12-06T02:51:12.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a96567ae-5828-4b74-8d69-b94d3d99dd33 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57122024-12-06T02:51:12.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a96567ae-5828-4b74-8d69-b94d3d99dd33 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57132024-12-06T02:51:12.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a96567ae-5828-4b74-8d69-b94d3d99dd33 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57142024-12-06T02:51:13.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab8b7994-8fbd-4489-92c1-b38cb7a2ab67 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57152024-12-06T02:51:13.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab8b7994-8fbd-4489-92c1-b38cb7a2ab67 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57162024-12-06T02:51:13.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab8b7994-8fbd-4489-92c1-b38cb7a2ab67 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57172024-12-06T02:51:14.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fd3d3c81-ffc7-4b03-89e2-816d2f49c63c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57182024-12-06T02:51:14.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fd3d3c81-ffc7-4b03-89e2-816d2f49c63c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57192024-12-06T02:51:14.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fd3d3c81-ffc7-4b03-89e2-816d2f49c63c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57202024-12-06T02:51:15.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1229 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = bfc1e0cc-ccdc-48d2-97d9-a5c70732a7d9 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
57212024-12-06T02:51:15.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 03dbba6d-3311-4b45-aa51-754def846926 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57222024-12-06T02:51:15.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 03dbba6d-3311-4b45-aa51-754def846926 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57232024-12-06T02:51:15.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 03dbba6d-3311-4b45-aa51-754def846926 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57242024-12-06T02:51:16.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 538c2d3f-ffb3-451a-b793-c3989304b456 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57252024-12-06T02:51:16.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 538c2d3f-ffb3-451a-b793-c3989304b456 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57262024-12-06T02:51:16.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 538c2d3f-ffb3-451a-b793-c3989304b456 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57272024-12-06T02:51:17.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 599a74a6-4afd-41cc-ab79-152800e642f5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57282024-12-06T02:51:17.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 599a74a6-4afd-41cc-ab79-152800e642f5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57292024-12-06T02:51:17.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 599a74a6-4afd-41cc-ab79-152800e642f5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57302024-12-06T02:51:18.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d721bb88-ada5-49a2-ade5-266307963a03 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57312024-12-06T02:51:18.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d721bb88-ada5-49a2-ade5-266307963a03 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57322024-12-06T02:51:18.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d721bb88-ada5-49a2-ade5-266307963a03 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57332024-12-06T02:51:19.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3985572c-b998-4a26-98d9-c63c68d441e5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57342024-12-06T02:51:19.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3985572c-b998-4a26-98d9-c63c68d441e5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57352024-12-06T02:51:19.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3985572c-b998-4a26-98d9-c63c68d441e5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57362024-12-06T02:51:20.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
57372024-12-06T02:51:20.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57382024-12-06T02:51:20.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
57392024-12-06T02:51:20.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57402024-12-06T02:51:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57412024-12-06T02:51:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57422024-12-06T02:51:20.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57432024-12-06T02:51:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57442024-12-06T02:51:20.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57452024-12-06T02:51:20.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57462024-12-06T02:51:20.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57472024-12-06T02:51:20.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57482024-12-06T02:51:20.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.037687ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57492024-12-06T02:51:20.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57502024-12-06T02:51:20.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57512024-12-06T02:51:20.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57522024-12-06T02:51:20.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
57532024-12-06T02:51:20.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57542024-12-06T02:51:20.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57552024-12-06T02:51:20.147ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
57562024-12-06T02:51:20.147ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.055135ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
57572024-12-06T02:51:20.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53a2c00b-11b4-4cf3-942b-83b5c9bfef06 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57582024-12-06T02:51:20.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53a2c00b-11b4-4cf3-942b-83b5c9bfef06 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57592024-12-06T02:51:20.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53a2c00b-11b4-4cf3-942b-83b5c9bfef06 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57602024-12-06T02:51:21.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53a01adc-ad24-4eac-af01-712912bdc0ff roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57612024-12-06T02:51:21.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53a01adc-ad24-4eac-af01-712912bdc0ff resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57622024-12-06T02:51:21.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 53a01adc-ad24-4eac-af01-712912bdc0ff response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57632024-12-06T02:51:22.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 676de028-e702-497d-871b-1bb07d3b9d64 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57642024-12-06T02:51:22.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 676de028-e702-497d-871b-1bb07d3b9d64 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57652024-12-06T02:51:22.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 676de028-e702-497d-871b-1bb07d3b9d64 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57662024-12-06T02:51:23.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 83974507-35dc-48f4-9539-14ab6eff498b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57672024-12-06T02:51:23.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 83974507-35dc-48f4-9539-14ab6eff498b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57682024-12-06T02:51:23.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 83974507-35dc-48f4-9539-14ab6eff498b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57692024-12-06T02:51:24.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 747f6932-086a-4fb8-98d8-28073f8a5a67 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57702024-12-06T02:51:24.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 747f6932-086a-4fb8-98d8-28073f8a5a67 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57712024-12-06T02:51:24.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 747f6932-086a-4fb8-98d8-28073f8a5a67 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57722024-12-06T02:51:25.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 9fb79502-0700-48fa-a70f-ef8c881f4a13 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
57732024-12-06T02:51:25.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 11ef9a53-6bbb-40ee-9647-50e2d38e3005 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57742024-12-06T02:51:25.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 11ef9a53-6bbb-40ee-9647-50e2d38e3005 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57752024-12-06T02:51:25.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 11ef9a53-6bbb-40ee-9647-50e2d38e3005 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57762024-12-06T02:51:26.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c054f908-5550-4712-8277-152eed7d503f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57772024-12-06T02:51:26.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c054f908-5550-4712-8277-152eed7d503f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57782024-12-06T02:51:26.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c054f908-5550-4712-8277-152eed7d503f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57792024-12-06T02:51:27.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b0f71c0b-c0c1-41a5-be4f-5ca96526421f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57802024-12-06T02:51:27.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b0f71c0b-c0c1-41a5-be4f-5ca96526421f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57812024-12-06T02:51:27.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b0f71c0b-c0c1-41a5-be4f-5ca96526421f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57822024-12-06T02:51:28.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 811aa311-a669-440f-8e8a-a46da56431c6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57832024-12-06T02:51:28.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 811aa311-a669-440f-8e8a-a46da56431c6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57842024-12-06T02:51:28.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 811aa311-a669-440f-8e8a-a46da56431c6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57852024-12-06T02:51:29.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 14f199f9-f221-4bdf-9963-a2bee59c12b0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57862024-12-06T02:51:29.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 14f199f9-f221-4bdf-9963-a2bee59c12b0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57872024-12-06T02:51:29.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 14f199f9-f221-4bdf-9963-a2bee59c12b0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
57882024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
57892024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57902024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
57912024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
57922024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57932024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57942024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57952024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
57962024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
57972024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57982024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57992024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
58002024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
58012024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58022024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58032024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
58042024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58052024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
58062024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58072024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
58082024-12-06T02:51:30.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58092024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58102024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
58112024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
58122024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58132024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
58142024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58152024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58162024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58172024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58182024-12-06T02:51:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58192024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58202024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58212024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58222024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58232024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58242024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58252024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58262024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58272024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
58282024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
58292024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58302024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58312024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
58322024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58332024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
58342024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58352024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58362024-12-06T02:51:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58372024-12-06T02:51:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58382024-12-06T02:51:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58392024-12-06T02:51:30.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58402024-12-06T02:51:30.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58412024-12-06T02:51:30.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58422024-12-06T02:51:30.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58432024-12-06T02:51:30.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58442024-12-06T02:51:30.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58452024-12-06T02:51:30.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58462024-12-06T02:51:30.113ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.826776ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58472024-12-06T02:51:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58482024-12-06T02:51:30.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58492024-12-06T02:51:30.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58502024-12-06T02:51:30.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512024-12-06T02:51:30.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58522024-12-06T02:51:30.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532024-12-06T02:51:30.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6238, tv_nsec: 485586966 } })
58542024-12-06T02:51:30.118ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6238, tv_nsec: 485974497 } })
58552024-12-06T02:51:30.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58562024-12-06T02:51:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58572024-12-06T02:51:30.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58582024-12-06T02:51:30.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58592024-12-06T02:51:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58602024-12-06T02:51:30.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58612024-12-06T02:51:30.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58622024-12-06T02:51:30.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58632024-12-06T02:51:30.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58642024-12-06T02:51:30.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58652024-12-06T02:51:30.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58662024-12-06T02:51:30.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672024-12-06T02:51:30.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58682024-12-06T02:51:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58692024-12-06T02:51:30.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 22.240094ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
58702024-12-06T02:51:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58712024-12-06T02:51:30.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58722024-12-06T02:51:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58732024-12-06T02:51:30.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.596879ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58742024-12-06T02:51:30.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58752024-12-06T02:51:30.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58762024-12-06T02:51:30.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58772024-12-06T02:51:30.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58782024-12-06T02:51:30.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58792024-12-06T02:51:30.142ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6238, tv_nsec: 510381493 } })
58802024-12-06T02:51:30.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58812024-12-06T02:51:30.142ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
58822024-12-06T02:51:30.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58832024-12-06T02:51:30.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
58842024-12-06T02:51:30.153ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58852024-12-06T02:51:30.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58862024-12-06T02:51:30.155ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58872024-12-06T02:51:30.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.361021ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58882024-12-06T02:51:30.165ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58892024-12-06T02:51:30.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58902024-12-06T02:51:30.168ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58912024-12-06T02:51:30.168ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58922024-12-06T02:51:30.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58932024-12-06T02:51:30.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58942024-12-06T02:51:30.182ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
58952024-12-06T02:51:30.182ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.539647ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
58962024-12-06T02:51:30.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972024-12-06T02:51:30.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58982024-12-06T02:51:30.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58992024-12-06T02:51:30.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59002024-12-06T02:51:30.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59012024-12-06T02:51:30.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59022024-12-06T02:51:30.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.225893ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
59032024-12-06T02:51:30.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59042024-12-06T02:51:30.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59052024-12-06T02:51:30.196ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59062024-12-06T02:51:30.197ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59072024-12-06T02:51:30.197ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59082024-12-06T02:51:30.197ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5dd92e6-3436-476a-8a8a-9f340d59c1e1", "content-length": "26", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
59092024-12-06T02:51:30.197ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59102024-12-06T02:51:30.197ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59112024-12-06T02:51:30.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59122024-12-06T02:51:30.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59132024-12-06T02:51:30.198ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59142024-12-06T02:51:30.199ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a27aa34-6cbb-4c39-9950-33c28df4a959", "content-length": "26", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
59152024-12-06T02:51:30.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59162024-12-06T02:51:30.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
59172024-12-06T02:51:30.199ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59182024-12-06T02:51:30.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59192024-12-06T02:51:30.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59202024-12-06T02:51:30.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59212024-12-06T02:51:30.202ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.882889ms iteration = 20 status = 0
59222024-12-06T02:51:30.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59232024-12-06T02:51:30.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59242024-12-06T02:51:30.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59252024-12-06T02:51:30.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59262024-12-06T02:51:30.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59272024-12-06T02:51:30.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59282024-12-06T02:51:30.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.663823ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59292024-12-06T02:51:30.216ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59302024-12-06T02:51:30.216ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59312024-12-06T02:51:30.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59322024-12-06T02:51:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59332024-12-06T02:51:30.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.063242ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59342024-12-06T02:51:30.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 147.277426ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59352024-12-06T02:51:30.250ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
59362024-12-06T02:51:30.250ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59372024-12-06T02:51:30.250ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e80d25e-ac37-4fd9-a0a9-2b52ffb11e9b", "content-length": "26", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
59382024-12-06T02:51:30.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59392024-12-06T02:51:30.252ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
59402024-12-06T02:51:30.270ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59412024-12-06T02:51:30.270ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59422024-12-06T02:51:30.270ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.476808ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59432024-12-06T02:51:30.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59442024-12-06T02:51:30.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59452024-12-06T02:51:30.297ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59462024-12-06T02:51:30.297ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d971c4f5-0894-4a07-880c-6e4cc516a4e2", "content-length": "1", "date": "Fri, 06 Dec 2024 02:51:29 GMT"} })
59472024-12-06T02:51:30.299ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59482024-12-06T02:51:30.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59492024-12-06T02:51:30.303ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.0753ms iteration = 20 status = null
59502024-12-06T02:51:30.312ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.605863ms iteration = 20 status = {}
59512024-12-06T02:51:30.327ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.306672ms iteration = 23 status = {"physical_disks_added":0}
59522024-12-06T02:51:30.362ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59532024-12-06T02:51:30.362ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59542024-12-06T02:51:30.363ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1424ba8c-c755-427a-b126-04ec4ad7fa61", "content-length": "372", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
59552024-12-06T02:51:30.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59562024-12-06T02:51:30.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59572024-12-06T02:51:30.380ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59582024-12-06T02:51:30.380ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59592024-12-06T02:51:30.380ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ecd1e7d8-b85d-4f97-99c3-b9a8af030bad", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
59602024-12-06T02:51:30.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59612024-12-06T02:51:30.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59622024-12-06T02:51:30.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59632024-12-06T02:51:30.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59642024-12-06T02:51:30.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59652024-12-06T02:51:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59662024-12-06T02:51:30.390ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59672024-12-06T02:51:30.390ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59682024-12-06T02:51:30.391ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3b2127b9-ccef-4c7c-946f-8bed9645195a", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
59692024-12-06T02:51:30.393ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 292.791643ms iteration = 21 status = {}
59702024-12-06T02:51:30.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59712024-12-06T02:51:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59722024-12-06T02:51:30.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59732024-12-06T02:51:30.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59742024-12-06T02:51:30.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59752024-12-06T02:51:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59762024-12-06T02:51:30.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59772024-12-06T02:51:30.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59782024-12-06T02:51:30.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59792024-12-06T02:51:30.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59802024-12-06T02:51:30.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59812024-12-06T02:51:30.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59822024-12-06T02:51:30.460ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
59832024-12-06T02:51:30.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59842024-12-06T02:51:30.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59852024-12-06T02:51:30.472ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59862024-12-06T02:51:30.472ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c17b058-fcb3-4116-81be-99c614a4d238", "content-length": "134", "date": "Fri, 06 Dec 2024 02:51:29 GMT"} })
59872024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59882024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
59892024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59902024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59912024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59922024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59932024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59942024-12-06T02:51:30.472ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59952024-12-06T02:51:30.473ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59962024-12-06T02:51:30.473ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59972024-12-06T02:51:30.473ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
59982024-12-06T02:51:30.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59992024-12-06T02:51:30.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60002024-12-06T02:51:30.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60012024-12-06T02:51:30.475ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60022024-12-06T02:51:30.475ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f9e948f-0b2e-4091-8847-8cc0b699e532", "content-length": "2", "date": "Fri, 06 Dec 2024 02:51:29 GMT"} })
60032024-12-06T02:51:30.475ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60042024-12-06T02:51:30.475ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ac9f949-b347-405c-8551-92d202378c0a", "content-length": "52", "date": "Fri, 06 Dec 2024 02:51:29 GMT"} })
60052024-12-06T02:51:30.475ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
60062024-12-06T02:51:30.475ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60072024-12-06T02:51:30.544ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4480106e-452d-4519-892f-5bf139cf9364", "content-length": "691", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
60082024-12-06T02:51:30.544ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60092024-12-06T02:51:30.544ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60102024-12-06T02:51:30.544ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60112024-12-06T02:51:30.545ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 445.400751ms iteration = 20 status = {}
60122024-12-06T02:51:30.630ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4518c69c-ae38-4057-ac2b-983458622f33", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
60132024-12-06T02:51:30.630ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
60142024-12-06T02:51:30.630ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60152024-12-06T02:51:30.634ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "95e87c96-dc0e-459c-9253-6855270647bd", "content-length": "682", "date": "Fri, 06 Dec 2024 02:51:30 GMT"} })
60162024-12-06T02:51:30.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60172024-12-06T02:51:30.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60182024-12-06T02:51:30.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60192024-12-06T02:51:30.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60202024-12-06T02:51:30.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60212024-12-06T02:51:30.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60222024-12-06T02:51:30.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60232024-12-06T02:51:30.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60242024-12-06T02:51:30.650ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.337749ms iteration = 20 status = {}
60252024-12-06T02:51:30.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f43b1087-cf20-46b0-8ec3-b024a1859d40 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60262024-12-06T02:51:30.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f43b1087-cf20-46b0-8ec3-b024a1859d40 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60272024-12-06T02:51:30.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f43b1087-cf20-46b0-8ec3-b024a1859d40 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60282024-12-06T02:51:31.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bf14df45-d211-401a-a680-95e7080f63fb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60292024-12-06T02:51:31.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bf14df45-d211-401a-a680-95e7080f63fb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60302024-12-06T02:51:31.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bf14df45-d211-401a-a680-95e7080f63fb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60312024-12-06T02:51:31.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 244a32df-9995-49e9-9bc1-14ab4a5204f7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60322024-12-06T02:51:31.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 244a32df-9995-49e9-9bc1-14ab4a5204f7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60332024-12-06T02:51:31.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 244a32df-9995-49e9-9bc1-14ab4a5204f7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60342024-12-06T02:51:32.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75d58763-3076-494d-8a01-d5b1a24107ae roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60352024-12-06T02:51:32.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75d58763-3076-494d-8a01-d5b1a24107ae resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60362024-12-06T02:51:32.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 75d58763-3076-494d-8a01-d5b1a24107ae response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60372024-12-06T02:51:33.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ac2bcb31-5bd1-42f2-ab12-46126e49e2e5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60382024-12-06T02:51:33.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ac2bcb31-5bd1-42f2-ab12-46126e49e2e5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60392024-12-06T02:51:33.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ac2bcb31-5bd1-42f2-ab12-46126e49e2e5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60402024-12-06T02:51:34.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 285e353d-bd0d-4c76-a820-5b7ec535e793 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60412024-12-06T02:51:34.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 285e353d-bd0d-4c76-a820-5b7ec535e793 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60422024-12-06T02:51:34.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 285e353d-bd0d-4c76-a820-5b7ec535e793 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60432024-12-06T02:51:35.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1175 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = b1eab26b-7afb-458a-826f-5049a01eeaa8 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
60442024-12-06T02:51:35.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = acd99492-66b2-4179-bbd6-c64a27a4d1b4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60452024-12-06T02:51:35.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = acd99492-66b2-4179-bbd6-c64a27a4d1b4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60462024-12-06T02:51:35.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = acd99492-66b2-4179-bbd6-c64a27a4d1b4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60472024-12-06T02:51:36.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e771a43a-3120-4c05-b95b-bc71f849feb8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60482024-12-06T02:51:36.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e771a43a-3120-4c05-b95b-bc71f849feb8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60492024-12-06T02:51:36.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e771a43a-3120-4c05-b95b-bc71f849feb8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60502024-12-06T02:51:37.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5924684c-df53-49d1-b58e-e661f36be998 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60512024-12-06T02:51:37.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5924684c-df53-49d1-b58e-e661f36be998 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60522024-12-06T02:51:37.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5924684c-df53-49d1-b58e-e661f36be998 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60532024-12-06T02:51:38.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = acf5de59-ea65-453e-9125-dd7dab5ee211 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60542024-12-06T02:51:38.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = acf5de59-ea65-453e-9125-dd7dab5ee211 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60552024-12-06T02:51:38.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = acf5de59-ea65-453e-9125-dd7dab5ee211 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60562024-12-06T02:51:39.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b0fb6b92-7f78-4753-af9e-93e4e7b4bb4a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60572024-12-06T02:51:39.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b0fb6b92-7f78-4753-af9e-93e4e7b4bb4a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60582024-12-06T02:51:39.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b0fb6b92-7f78-4753-af9e-93e4e7b4bb4a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60592024-12-06T02:51:40.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
60602024-12-06T02:51:40.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60612024-12-06T02:51:40.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
60622024-12-06T02:51:40.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60632024-12-06T02:51:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60642024-12-06T02:51:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60652024-12-06T02:51:40.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60662024-12-06T02:51:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60672024-12-06T02:51:40.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60682024-12-06T02:51:40.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60692024-12-06T02:51:40.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60702024-12-06T02:51:40.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60712024-12-06T02:51:40.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60722024-12-06T02:51:40.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60732024-12-06T02:51:40.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60742024-12-06T02:51:40.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
60752024-12-06T02:51:40.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60762024-12-06T02:51:40.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60772024-12-06T02:51:40.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
60782024-12-06T02:51:40.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.749889ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
60792024-12-06T02:51:40.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.432366ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60802024-12-06T02:51:40.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e40da8ad-946a-4c7e-86d0-f72f3b270583 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60812024-12-06T02:51:40.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e40da8ad-946a-4c7e-86d0-f72f3b270583 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60822024-12-06T02:51:40.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e40da8ad-946a-4c7e-86d0-f72f3b270583 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60832024-12-06T02:51:41.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a66af8ce-fc65-47c7-8c82-a25fcf20748d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60842024-12-06T02:51:41.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a66af8ce-fc65-47c7-8c82-a25fcf20748d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60852024-12-06T02:51:41.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a66af8ce-fc65-47c7-8c82-a25fcf20748d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60862024-12-06T02:51:42.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 67e4cd1b-3d76-4a89-b290-70a0e7d9452c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60872024-12-06T02:51:42.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 67e4cd1b-3d76-4a89-b290-70a0e7d9452c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60882024-12-06T02:51:42.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 67e4cd1b-3d76-4a89-b290-70a0e7d9452c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60892024-12-06T02:51:43.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 028ef639-c710-404d-acf0-7ce7456df9f3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60902024-12-06T02:51:43.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 028ef639-c710-404d-acf0-7ce7456df9f3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60912024-12-06T02:51:43.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 028ef639-c710-404d-acf0-7ce7456df9f3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60922024-12-06T02:51:45.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d77cfa2-9260-4f8a-b5a8-6c2cd08b840c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60932024-12-06T02:51:45.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d77cfa2-9260-4f8a-b5a8-6c2cd08b840c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60942024-12-06T02:51:45.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d77cfa2-9260-4f8a-b5a8-6c2cd08b840c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60952024-12-06T02:51:45.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1179 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 47e5b502-5341-4dde-bb86-621acdc083fe response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
60962024-12-06T02:51:46.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3b720341-b447-4580-8af4-994bcc36c300 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60972024-12-06T02:51:46.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3b720341-b447-4580-8af4-994bcc36c300 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60982024-12-06T02:51:46.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3b720341-b447-4580-8af4-994bcc36c300 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
60992024-12-06T02:51:47.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8051bfa5-9a50-4dbc-88d9-73941690ea3c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61002024-12-06T02:51:47.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8051bfa5-9a50-4dbc-88d9-73941690ea3c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61012024-12-06T02:51:47.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8051bfa5-9a50-4dbc-88d9-73941690ea3c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61022024-12-06T02:51:48.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2890f99f-7116-423e-81a3-2a1f69571e21 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61032024-12-06T02:51:48.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2890f99f-7116-423e-81a3-2a1f69571e21 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61042024-12-06T02:51:48.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2890f99f-7116-423e-81a3-2a1f69571e21 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61052024-12-06T02:51:49.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 60b1de8b-92f7-43c2-bbca-b657037ad23f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61062024-12-06T02:51:49.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 60b1de8b-92f7-43c2-bbca-b657037ad23f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61072024-12-06T02:51:49.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 60b1de8b-92f7-43c2-bbca-b657037ad23f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61082024-12-06T02:51:50.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
61092024-12-06T02:51:50.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
61102024-12-06T02:51:50.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61112024-12-06T02:51:50.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61122024-12-06T02:51:50.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61132024-12-06T02:51:50.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61142024-12-06T02:51:50.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61152024-12-06T02:51:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61162024-12-06T02:51:50.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61172024-12-06T02:51:50.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.489769ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61182024-12-06T02:51:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61192024-12-06T02:51:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61202024-12-06T02:51:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61212024-12-06T02:51:50.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61222024-12-06T02:51:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61232024-12-06T02:51:50.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61242024-12-06T02:51:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
61252024-12-06T02:51:50.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61262024-12-06T02:51:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61272024-12-06T02:51:50.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7d4d9d3-2a48-4243-8408-08db2e93bdad roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61282024-12-06T02:51:50.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7d4d9d3-2a48-4243-8408-08db2e93bdad resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61292024-12-06T02:51:50.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a7d4d9d3-2a48-4243-8408-08db2e93bdad response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61302024-12-06T02:51:50.119ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
61312024-12-06T02:51:50.119ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.482586ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
61322024-12-06T02:51:51.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 856cca5c-6467-46e9-afa7-97eeb037b3fd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61332024-12-06T02:51:51.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 856cca5c-6467-46e9-afa7-97eeb037b3fd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61342024-12-06T02:51:51.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 856cca5c-6467-46e9-afa7-97eeb037b3fd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61352024-12-06T02:51:52.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8299deb-9db8-4a62-918b-94346ae07d56 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61362024-12-06T02:51:52.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8299deb-9db8-4a62-918b-94346ae07d56 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61372024-12-06T02:51:52.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d8299deb-9db8-4a62-918b-94346ae07d56 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61382024-12-06T02:51:53.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4746c2aa-a672-41c1-9628-0446b7c4d02a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61392024-12-06T02:51:53.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4746c2aa-a672-41c1-9628-0446b7c4d02a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61402024-12-06T02:51:53.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4746c2aa-a672-41c1-9628-0446b7c4d02a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61412024-12-06T02:51:54.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9e08fb9c-a339-4325-89dd-ba857463b8fc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61422024-12-06T02:51:54.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9e08fb9c-a339-4325-89dd-ba857463b8fc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61432024-12-06T02:51:54.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9e08fb9c-a339-4325-89dd-ba857463b8fc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61442024-12-06T02:51:55.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1209 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = f06e9d71-9ba6-4d24-8dc0-5dd95d6cc15c response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
61452024-12-06T02:51:55.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d54f14bb-0ffb-49c8-912e-d9bed60498a9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61462024-12-06T02:51:55.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d54f14bb-0ffb-49c8-912e-d9bed60498a9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61472024-12-06T02:51:55.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d54f14bb-0ffb-49c8-912e-d9bed60498a9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61482024-12-06T02:51:56.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6647a67b-3c0c-45a8-a1fb-cad65b474a54 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61492024-12-06T02:51:56.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6647a67b-3c0c-45a8-a1fb-cad65b474a54 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61502024-12-06T02:51:56.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6647a67b-3c0c-45a8-a1fb-cad65b474a54 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61512024-12-06T02:51:57.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0306de26-6073-4869-9279-529e98792957 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61522024-12-06T02:51:57.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0306de26-6073-4869-9279-529e98792957 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61532024-12-06T02:51:57.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0306de26-6073-4869-9279-529e98792957 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61542024-12-06T02:51:58.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b9c408f4-e8fe-4c30-9ff4-ffdf85a85c72 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61552024-12-06T02:51:58.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b9c408f4-e8fe-4c30-9ff4-ffdf85a85c72 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61562024-12-06T02:51:58.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b9c408f4-e8fe-4c30-9ff4-ffdf85a85c72 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61572024-12-06T02:51:59.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0d9947a3-abb2-4928-95c9-e13823354c25 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61582024-12-06T02:51:59.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0d9947a3-abb2-4928-95c9-e13823354c25 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61592024-12-06T02:51:59.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0d9947a3-abb2-4928-95c9-e13823354c25 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
61602024-12-06T02:52:00.015ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:36852
61612024-12-06T02:52:00.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 135ac7d1-2cda-44c4-9dff-06205079a9ab roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
61622024-12-06T02:52:00.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 135ac7d1-2cda-44c4-9dff-06205079a9ab resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
61632024-12-06T02:52:00.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 135ac7d1-2cda-44c4-9dff-06205079a9ab response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
61642024-12-06T02:52:00.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 1bfed6de-8342-4e08-92cb-cb10e80a3821 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
61652024-12-06T02:52:00.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 1bfed6de-8342-4e08-92cb-cb10e80a3821 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
61662024-12-06T02:52:00.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 1bfed6de-8342-4e08-92cb-cb10e80a3821 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
61672024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
61682024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
61692024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61702024-12-06T02:52:00.101ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61712024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
61722024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61732024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61742024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
61752024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
61762024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
61772024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61782024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
61792024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
61802024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61812024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61822024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
61832024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61842024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61852024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
61862024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61872024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
61882024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
61892024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61902024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61912024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61922024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
61932024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61942024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
61952024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61962024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
61972024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61982024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
61992024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
62002024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62012024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62022024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
62032024-12-06T02:52:00.101ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
62042024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62052024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
62062024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
62072024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
62082024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62092024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
62102024-12-06T02:52:00.101ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
62112024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
62122024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62132024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
62142024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.151\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
62152024-12-06T02:52:00.101ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:42:00.101475239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
62162024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
62172024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
62182024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62192024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
62202024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
62212024-12-06T02:52:00.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62222024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62232024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
62242024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62252024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62262024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
62272024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62282024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
62292024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62302024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62312024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
62322024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62332024-12-06T02:52:00.101ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
62342024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
62352024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
62362024-12-06T02:52:00.101ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
62372024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62382024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62392024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62402024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62412024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62422024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62432024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62442024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62452024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62462024-12-06T02:52:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62472024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62482024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62492024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62502024-12-06T02:52:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6268, tv_nsec: 469934896 } })
62512024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62522024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62532024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62542024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62552024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62562024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62572024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62582024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62592024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62602024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62612024-12-06T02:52:00.102ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
62622024-12-06T02:52:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6268, tv_nsec: 470077740 } })
62632024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62642024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62652024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62662024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62672024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
62682024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.470822ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62692024-12-06T02:52:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.528153ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
62702024-12-06T02:52:00.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62712024-12-06T02:52:00.113ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.760564ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62722024-12-06T02:52:00.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732024-12-06T02:52:00.115ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62742024-12-06T02:52:00.115ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62752024-12-06T02:52:00.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62762024-12-06T02:52:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62772024-12-06T02:52:00.116ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62782024-12-06T02:52:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62792024-12-06T02:52:00.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62802024-12-06T02:52:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62812024-12-06T02:52:00.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6268, tv_nsec: 484739859 } })
62822024-12-06T02:52:00.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62832024-12-06T02:52:00.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62842024-12-06T02:52:00.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62852024-12-06T02:52:00.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62862024-12-06T02:52:00.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62872024-12-06T02:52:00.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62882024-12-06T02:52:00.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62892024-12-06T02:52:00.123ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62902024-12-06T02:52:00.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62912024-12-06T02:52:00.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62922024-12-06T02:52:00.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62932024-12-06T02:52:00.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62942024-12-06T02:52:00.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62952024-12-06T02:52:00.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62962024-12-06T02:52:00.127ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
62972024-12-06T02:52:00.127ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
62982024-12-06T02:52:00.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
62992024-12-06T02:52:00.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63002024-12-06T02:52:00.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63012024-12-06T02:52:00.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63022024-12-06T02:52:00.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63032024-12-06T02:52:00.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63042024-12-06T02:52:00.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63052024-12-06T02:52:00.132ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6268, tv_nsec: 499973144 } })
63062024-12-06T02:52:00.132ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:42:00.101475239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63072024-12-06T02:52:00.132ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.690237ms iteration = 11 status = {"expiration":"2024-12-06T02:42:00.101475239Z","pruned":[]}
63082024-12-06T02:52:00.132ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
63092024-12-06T02:52:00.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63102024-12-06T02:52:00.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63112024-12-06T02:52:00.145ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.542964ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
63122024-12-06T02:52:00.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63132024-12-06T02:52:00.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63142024-12-06T02:52:00.159ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 57.595645ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
63152024-12-06T02:52:00.159ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63162024-12-06T02:52:00.159ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63172024-12-06T02:52:00.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63182024-12-06T02:52:00.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63192024-12-06T02:52:00.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6268, tv_nsec: 529309802 } })
63202024-12-06T02:52:00.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63212024-12-06T02:52:00.161ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
63222024-12-06T02:52:00.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63232024-12-06T02:52:00.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63242024-12-06T02:52:00.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63252024-12-06T02:52:00.165ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63262024-12-06T02:52:00.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63272024-12-06T02:52:00.169ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63282024-12-06T02:52:00.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63292024-12-06T02:52:00.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63302024-12-06T02:52:00.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63312024-12-06T02:52:00.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-12-06T02:52:00.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63332024-12-06T02:52:00.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63342024-12-06T02:52:00.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63352024-12-06T02:52:00.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63362024-12-06T02:52:00.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63372024-12-06T02:52:00.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63382024-12-06T02:52:00.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63392024-12-06T02:52:00.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63402024-12-06T02:52:00.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63412024-12-06T02:52:00.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422024-12-06T02:52:00.194ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63432024-12-06T02:52:00.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63442024-12-06T02:52:00.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63452024-12-06T02:52:00.198ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462024-12-06T02:52:00.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63472024-12-06T02:52:00.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
63482024-12-06T02:52:00.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63492024-12-06T02:52:00.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63502024-12-06T02:52:00.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63512024-12-06T02:52:00.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63522024-12-06T02:52:00.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63532024-12-06T02:52:00.208ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542024-12-06T02:52:00.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63552024-12-06T02:52:00.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63562024-12-06T02:52:00.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63572024-12-06T02:52:00.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63582024-12-06T02:52:00.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63592024-12-06T02:52:00.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 116.042314ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
63602024-12-06T02:52:00.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63612024-12-06T02:52:00.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63622024-12-06T02:52:00.221ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63632024-12-06T02:52:00.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.153332ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63642024-12-06T02:52:00.221ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63652024-12-06T02:52:00.221ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 119.896625ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63662024-12-06T02:52:00.223ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63672024-12-06T02:52:00.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63682024-12-06T02:52:00.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63692024-12-06T02:52:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63702024-12-06T02:52:00.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63712024-12-06T02:52:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63722024-12-06T02:52:00.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63732024-12-06T02:52:00.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63742024-12-06T02:52:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63752024-12-06T02:52:00.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63762024-12-06T02:52:00.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63772024-12-06T02:52:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63782024-12-06T02:52:00.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63792024-12-06T02:52:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63802024-12-06T02:52:00.235ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
63812024-12-06T02:52:00.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.158492ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
63822024-12-06T02:52:00.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 136.123478ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63832024-12-06T02:52:00.239ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(e17b0273-3e94-46d3-8d9a-e9dc1ce3a67c, 0), (8d43e96c-3f29-416a-910e-3fad3eb8616f, 0), (0c4dff67-4005-4e9c-87fd-6566de8d395d, 0)]
63842024-12-06T02:52:00.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6268, tv_nsec: 608177335 } })
63852024-12-06T02:52:00.246ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63862024-12-06T02:52:00.246ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63872024-12-06T02:52:00.246ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63882024-12-06T02:52:00.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63892024-12-06T02:52:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63902024-12-06T02:52:00.257ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
63912024-12-06T02:52:00.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63922024-12-06T02:52:00.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63932024-12-06T02:52:00.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63942024-12-06T02:52:00.272ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63952024-12-06T02:52:00.272ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63962024-12-06T02:52:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63972024-12-06T02:52:00.272ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3e12141-b616-45cc-8736-6629affd0bc3", "content-length": "26", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
63982024-12-06T02:52:00.272ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63992024-12-06T02:52:00.273ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
64002024-12-06T02:52:00.273ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
64012024-12-06T02:52:00.273ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 172.681862ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
64022024-12-06T02:52:00.275ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64032024-12-06T02:52:00.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64042024-12-06T02:52:00.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64052024-12-06T02:52:00.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64062024-12-06T02:52:00.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
64072024-12-06T02:52:00.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64082024-12-06T02:52:00.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64092024-12-06T02:52:00.286ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64102024-12-06T02:52:00.286ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64112024-12-06T02:52:00.286ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.341634ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64122024-12-06T02:52:00.288ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 187.415464ms iteration = 21 status = 0
64132024-12-06T02:52:00.290ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
64142024-12-06T02:52:00.290ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 189.240946ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64152024-12-06T02:52:00.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64162024-12-06T02:52:00.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64172024-12-06T02:52:00.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182024-12-06T02:52:00.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64192024-12-06T02:52:00.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64202024-12-06T02:52:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64212024-12-06T02:52:00.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64222024-12-06T02:52:00.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64232024-12-06T02:52:00.304ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64242024-12-06T02:52:00.308ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
64252024-12-06T02:52:00.308ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
64262024-12-06T02:52:00.308ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
64272024-12-06T02:52:00.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64282024-12-06T02:52:00.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64292024-12-06T02:52:00.310ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64302024-12-06T02:52:00.310ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 208.690861ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64312024-12-06T02:52:00.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64322024-12-06T02:52:00.311ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
64332024-12-06T02:52:00.311ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64342024-12-06T02:52:00.311ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a92d11c-2152-4260-a912-ad680899356a", "content-length": "26", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
64352024-12-06T02:52:00.311ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64362024-12-06T02:52:00.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
64372024-12-06T02:52:00.314ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.84766ms iteration = 24 status = {"physical_disks_added":0}
64382024-12-06T02:52:00.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64392024-12-06T02:52:00.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64402024-12-06T02:52:00.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64412024-12-06T02:52:00.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64422024-12-06T02:52:00.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64432024-12-06T02:52:00.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64442024-12-06T02:52:00.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64452024-12-06T02:52:00.327ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
64462024-12-06T02:52:00.327ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 8828710b-8a7e-40fc-9a46-7712f8a5f6f4
64472024-12-06T02:52:00.327ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 474de36c-8d59-40e6-bca5-00b0a949b515
64482024-12-06T02:52:00.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8fc48eff-7fc2-41d0-a67a-500470330505 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
64492024-12-06T02:52:00.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8fc48eff-7fc2-41d0-a67a-500470330505 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
64502024-12-06T02:52:00.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 226.919721ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64512024-12-06T02:52:00.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8fc48eff-7fc2-41d0-a67a-500470330505 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
64522024-12-06T02:52:00.332ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 9a9fc754-7ae5-4194-838f-899b4dab82e6
64532024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 474de36c-8d59-40e6-bca5-00b0a949b515
64542024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 8828710b-8a7e-40fc-9a46-7712f8a5f6f4
64552024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 9a9fc754-7ae5-4194-838f-899b4dab82e6
64562024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 230.884235ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
64572024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64582024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64592024-12-06T02:52:00.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64602024-12-06T02:52:00.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64612024-12-06T02:52:00.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64622024-12-06T02:52:00.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64632024-12-06T02:52:00.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64642024-12-06T02:52:00.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64652024-12-06T02:52:00.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64662024-12-06T02:52:00.346ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64672024-12-06T02:52:00.349ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64682024-12-06T02:52:00.349ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64692024-12-06T02:52:00.349ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
64702024-12-06T02:52:00.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 247.290234ms iteration = 12 status = {"generation":1}
64712024-12-06T02:52:00.351ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "55d4e9be-774a-40b9-9d3a-b834f7258003", "content-length": "26", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
64722024-12-06T02:52:00.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64732024-12-06T02:52:00.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64742024-12-06T02:52:00.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 257.864956ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64752024-12-06T02:52:00.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64762024-12-06T02:52:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64772024-12-06T02:52:00.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64782024-12-06T02:52:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
64792024-12-06T02:52:00.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64802024-12-06T02:52:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64812024-12-06T02:52:00.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64822024-12-06T02:52:00.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64832024-12-06T02:52:00.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64842024-12-06T02:52:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64852024-12-06T02:52:00.384ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64862024-12-06T02:52:00.384ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
64872024-12-06T02:52:00.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64882024-12-06T02:52:00.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892024-12-06T02:52:00.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64902024-12-06T02:52:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
64912024-12-06T02:52:00.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64922024-12-06T02:52:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64932024-12-06T02:52:00.390ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64942024-12-06T02:52:00.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64952024-12-06T02:52:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64962024-12-06T02:52:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64972024-12-06T02:52:00.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64982024-12-06T02:52:00.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64992024-12-06T02:52:00.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65002024-12-06T02:52:00.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65012024-12-06T02:52:00.396ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
65022024-12-06T02:52:00.396ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
65032024-12-06T02:52:00.396ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
65042024-12-06T02:52:00.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 294.931114ms iteration = 12 status = {"generation":2}
65052024-12-06T02:52:00.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65062024-12-06T02:52:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65072024-12-06T02:52:00.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65082024-12-06T02:52:00.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65092024-12-06T02:52:00.405ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65102024-12-06T02:52:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65112024-12-06T02:52:00.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65122024-12-06T02:52:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65132024-12-06T02:52:00.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65142024-12-06T02:52:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65152024-12-06T02:52:00.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162024-12-06T02:52:00.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65172024-12-06T02:52:00.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65182024-12-06T02:52:00.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65192024-12-06T02:52:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
65202024-12-06T02:52:00.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65212024-12-06T02:52:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65222024-12-06T02:52:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65232024-12-06T02:52:00.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65242024-12-06T02:52:00.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65252024-12-06T02:52:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65262024-12-06T02:52:00.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65272024-12-06T02:52:00.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65282024-12-06T02:52:00.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65292024-12-06T02:52:00.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65302024-12-06T02:52:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65312024-12-06T02:52:00.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65322024-12-06T02:52:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65332024-12-06T02:52:00.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65342024-12-06T02:52:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65352024-12-06T02:52:00.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65362024-12-06T02:52:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65372024-12-06T02:52:00.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65382024-12-06T02:52:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65392024-12-06T02:52:00.454ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
65402024-12-06T02:52:00.454ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
65412024-12-06T02:52:00.454ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
65422024-12-06T02:52:00.455ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d42bc8c2-07e0-4043-82e6-ea499c5530dd", "content-length": "476", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65432024-12-06T02:52:00.455ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
65442024-12-06T02:52:00.455ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "322d5ae9-f52b-4670-a85d-faae89ca217d", "content-length": "734", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65452024-12-06T02:52:00.455ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
65462024-12-06T02:52:00.456ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
65472024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 355.003901ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
65482024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "09e30356-7d0d-465c-b6f8-c9366b798c20", "content-length": "111", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65492024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
65502024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3eca753-3958-4344-9e57-1b11d5e94fb0", "content-length": "111", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65512024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
65522024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3899cdd-61e6-404c-bbf6-f0fd7372dc82", "content-length": "167", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65532024-12-06T02:52:00.456ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
65542024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac85a6f0-8c78-448a-8bbf-f6f6db49f1d6", "content-length": "167", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65552024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
65562024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3157f391-0199-4191-9527-0172c4bce48b", "content-length": "175", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65572024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
65582024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fa3f95b-f397-4f3d-9d64-422b42455808", "content-length": "175", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65592024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
65602024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b268c660-a70f-4a66-bbfe-e149b9c3f9cd", "content-length": "702", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65612024-12-06T02:52:00.457ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
65622024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5c09ce-e371-4faf-9cce-fa18fd8919f9", "content-length": "727", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65632024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
65642024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eec21787-f786-4258-8eca-2cd466e7d407", "content-length": "729", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65652024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
65662024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "789fe45a-20d5-4746-8629-a7f779485ba6", "content-length": "728", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65672024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
65682024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1edd58c8-a5e3-49b5-bc9c-0d31b502e7e3", "content-length": "722", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65692024-12-06T02:52:00.458ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
65702024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d1279a8-9336-4fbf-82e6-9712df685d95", "content-length": "109", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65712024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
65722024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e43aa14-7efd-4d08-9f31-829272cf5a7f", "content-length": "109", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65732024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
65742024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0185995c-a537-4130-b4bf-611728f19ff8", "content-length": "169", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65752024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
65762024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "88f1a39b-8505-4c7b-8d74-6a35c1541ee1", "content-length": "169", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65772024-12-06T02:52:00.459ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
65782024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75e7205-1c40-4040-87d7-1716b7fbc08f", "content-length": "178", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65792024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
65802024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "267e855e-cbf4-46a7-9821-9b597950a372", "content-length": "178", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65812024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
65822024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6ef4a30-1ff2-458f-9d18-8bd11abfe841", "content-length": "702", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65832024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
65842024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c1c678a-ef9d-4b61-b9c4-ad05a76b3be5", "content-length": "727", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65852024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
65862024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3dd03f3-1cd6-44af-9e1e-9f7903963214", "content-length": "729", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65872024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
65882024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "569fd50f-78d8-41ce-8d17-ae728d877112", "content-length": "728", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
65892024-12-06T02:52:00.460ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65902024-12-06T02:52:00.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65912024-12-06T02:52:00.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
65922024-12-06T02:52:00.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
65932024-12-06T02:52:00.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4bcbfb32-621c-4186-b4c1-aa3f9c358c67", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65942024-12-06T02:52:00.541ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65952024-12-06T02:52:00.543ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c756fb2d-cbd2-4169-b05f-692d7a2ff065", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65962024-12-06T02:52:00.543ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65972024-12-06T02:52:00.544ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65982024-12-06T02:52:00.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 443.417526ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
65992024-12-06T02:52:00.573ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66002024-12-06T02:52:00.573ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66012024-12-06T02:52:00.573ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "be0bfe2b-11bc-4f7e-88bc-06dbe39553f5", "content-length": "372", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66022024-12-06T02:52:00.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66032024-12-06T02:52:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66042024-12-06T02:52:00.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66052024-12-06T02:52:00.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
66062024-12-06T02:52:00.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66072024-12-06T02:52:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66082024-12-06T02:52:00.586ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36722
66092024-12-06T02:52:00.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36722 req_id = faaa1ae3-c9a2-4d4d-a567-653b2bdf95b6 roles = RoleSet { roles: {} } uri = /metrics/producers
66102024-12-06T02:52:00.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36722 req_id = faaa1ae3-c9a2-4d4d-a567-653b2bdf95b6 resource = Database result = Ok(()) uri = /metrics/producers
66112024-12-06T02:52:00.599ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66122024-12-06T02:52:00.600ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d44080a-7bac-4e2c-9525-ffaa34f51a76", "content-length": "1", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66132024-12-06T02:52:00.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66142024-12-06T02:52:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66152024-12-06T02:52:00.627ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 526.476258ms iteration = 21 status = {}
66162024-12-06T02:52:00.640ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
66172024-12-06T02:52:00.641ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b9c59b63-6eef-484c-a156-4dc46f695364", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66182024-12-06T02:52:00.641ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66192024-12-06T02:52:00.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0a465004-4c37-43e0-bd10-9f80ce52b05f", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66202024-12-06T02:52:00.643ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66212024-12-06T02:52:00.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a37d199b-c13b-46a0-8678-835c2d22fa5f", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66222024-12-06T02:52:00.645ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66232024-12-06T02:52:00.647ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
66242024-12-06T02:52:00.647ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 546.275774ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
66252024-12-06T02:52:00.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66262024-12-06T02:52:00.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85c36963-ee30-4cb8-80ba-1af2bcb400e8", "content-length": "691", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66272024-12-06T02:52:00.648ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66282024-12-06T02:52:00.648ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66292024-12-06T02:52:00.648ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66302024-12-06T02:52:00.649ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66312024-12-06T02:52:00.650ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 549.344952ms iteration = 21 status = {}
66322024-12-06T02:52:00.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
66332024-12-06T02:52:00.651ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66342024-12-06T02:52:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66352024-12-06T02:52:00.654ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.924474ms iteration = 21 status = null
66362024-12-06T02:52:00.663ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66372024-12-06T02:52:00.663ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66382024-12-06T02:52:00.664ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a2cd29c3-8cd9-4f11-b616-30184fc2ea06", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66392024-12-06T02:52:00.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66402024-12-06T02:52:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66412024-12-06T02:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66422024-12-06T02:52:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66432024-12-06T02:52:00.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66442024-12-06T02:52:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66452024-12-06T02:52:00.672ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66462024-12-06T02:52:00.672ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66472024-12-06T02:52:00.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66482024-12-06T02:52:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66492024-12-06T02:52:00.682ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66502024-12-06T02:52:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66512024-12-06T02:52:00.687ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66522024-12-06T02:52:00.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66532024-12-06T02:52:00.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66542024-12-06T02:52:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66552024-12-06T02:52:00.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
66562024-12-06T02:52:00.690ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66572024-12-06T02:52:00.690ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 6379dfe0-2a46-4638-967d-13828cc17f6c
66582024-12-06T02:52:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66592024-12-06T02:52:00.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103739 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36722 req_id = faaa1ae3-c9a2-4d4d-a567-653b2bdf95b6 response_code = 201 uri = /metrics/producers
66602024-12-06T02:52:00.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
66612024-12-06T02:52:00.692ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66622024-12-06T02:52:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66632024-12-06T02:52:00.692ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
66642024-12-06T02:52:00.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66652024-12-06T02:52:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66662024-12-06T02:52:00.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "924da812-02a6-4af8-a442-8a7b7f673aba", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66672024-12-06T02:52:00.696ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 594.656485ms iteration = 22 status = {}
66682024-12-06T02:52:00.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66692024-12-06T02:52:00.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66702024-12-06T02:52:00.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66712024-12-06T02:52:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66722024-12-06T02:52:00.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66732024-12-06T02:52:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66742024-12-06T02:52:00.704ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66752024-12-06T02:52:00.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66762024-12-06T02:52:00.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66772024-12-06T02:52:00.704ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a0bded0-16d4-42aa-8033-248ad2d762bd", "content-length": "134", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66782024-12-06T02:52:00.704ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66792024-12-06T02:52:00.704ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
66802024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66812024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66822024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66832024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66842024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66852024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66862024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66872024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66882024-12-06T02:52:00.705ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
66892024-12-06T02:52:00.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66902024-12-06T02:52:00.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66912024-12-06T02:52:00.707ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66922024-12-06T02:52:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66932024-12-06T02:52:00.707ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66942024-12-06T02:52:00.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c3217d-18ce-4f89-a8ee-4d6eb4b76f29", "content-length": "2", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66952024-12-06T02:52:00.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66962024-12-06T02:52:00.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50b5327-10df-4f62-be3b-c42b418de40a", "content-length": "52", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
66972024-12-06T02:52:00.708ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
66982024-12-06T02:52:00.708ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66992024-12-06T02:52:00.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67002024-12-06T02:52:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67012024-12-06T02:52:00.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67022024-12-06T02:52:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67032024-12-06T02:52:00.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042024-12-06T02:52:00.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
67052024-12-06T02:52:00.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67062024-12-06T02:52:00.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67072024-12-06T02:52:00.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67082024-12-06T02:52:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67092024-12-06T02:52:00.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67102024-12-06T02:52:00.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67112024-12-06T02:52:00.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67122024-12-06T02:52:00.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
67132024-12-06T02:52:00.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67142024-12-06T02:52:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67152024-12-06T02:52:00.731ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
67162024-12-06T02:52:00.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67172024-12-06T02:52:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67182024-12-06T02:52:00.732ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67192024-12-06T02:52:00.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
67202024-12-06T02:52:00.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67212024-12-06T02:52:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67222024-12-06T02:52:00.736ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
67232024-12-06T02:52:00.736ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
67242024-12-06T02:52:00.736ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
67252024-12-06T02:52:00.784ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
67262024-12-06T02:52:00.784ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
67272024-12-06T02:52:00.788ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5455a27f-b1dd-4d8d-adde-726221dabebe, time_created: 2024-12-06T02:42:27.098106Z, time_modified: 2024-12-06T02:42:27.098106Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
67282024-12-06T02:52:00.789ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
67292024-12-06T02:52:00.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67302024-12-06T02:52:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67312024-12-06T02:52:00.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67322024-12-06T02:52:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67332024-12-06T02:52:00.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67342024-12-06T02:52:00.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
67352024-12-06T02:52:00.826ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
67362024-12-06T02:52:00.827ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "e7463e57-fb37-4c3f-8eb1-c8cf16923d73", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
67372024-12-06T02:52:00.829ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
67382024-12-06T02:52:00.829ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 728.475068ms
67392024-12-06T02:52:00.829ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 728.487248ms iteration = 3 status = {}
67402024-12-06T02:52:00.863ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58736
67412024-12-06T02:52:00.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58736 req_id = 97a30107-a8dc-427e-8f2b-332ba97a5807 roles = RoleSet { roles: {} } uri = /metrics/producers
67422024-12-06T02:52:00.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58736 req_id = 97a30107-a8dc-427e-8f2b-332ba97a5807 resource = Database result = Ok(()) uri = /metrics/producers
67432024-12-06T02:52:00.898ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3c6a3a2f-feb7-45e4-8652-d9c5f1a56f83
67442024-12-06T02:52:00.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35075 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58736 req_id = 97a30107-a8dc-427e-8f2b-332ba97a5807 response_code = 201 uri = /metrics/producers
67452024-12-06T02:52:00.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff512de0-632f-4a62-9a18-38e7c646943a", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
67462024-12-06T02:52:00.906ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
67472024-12-06T02:52:00.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67482024-12-06T02:52:00.907ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7a144f1-1524-459d-bd0c-6639b3a94fd7", "content-length": "682", "date": "Fri, 06 Dec 2024 02:52:00 GMT"} })
67492024-12-06T02:52:00.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67502024-12-06T02:52:00.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67512024-12-06T02:52:00.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67522024-12-06T02:52:00.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67532024-12-06T02:52:00.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67542024-12-06T02:52:00.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67552024-12-06T02:52:00.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67562024-12-06T02:52:00.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67572024-12-06T02:52:00.923ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 822.063971ms iteration = 21 status = {}
67582024-12-06T02:52:01.147ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "00688f02-7939-4eb9-8177-62e8e0443c75", "content-length": "30797", "date": "Fri, 06 Dec 2024 02:52:01 GMT"} })
67592024-12-06T02:52:01.149ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
67602024-12-06T02:52:01.149ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
67612024-12-06T02:52:01.149ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
67622024-12-06T02:52:01.151ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67632024-12-06T02:52:01.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67642024-12-06T02:52:01.153ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67652024-12-06T02:52:01.155ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
67662024-12-06T02:52:01.155ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67672024-12-06T02:52:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67682024-12-06T02:52:01.314ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c2dabc7a-ee41-498a-a5d3-e9b963c7a393 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
67692024-12-06T02:52:01.314ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c2dabc7a-ee41-498a-a5d3-e9b963c7a393 time_started = 2024-12-06 02:52:00.454924 UTC
67702024-12-06T02:52:01.314ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.213571513s iteration = 4 status = {"collection_id":"c2dabc7a-ee41-498a-a5d3-e9b963c7a393","time_done":"2024-12-06 02:52:01.149638 UTC","time_started":"2024-12-06 02:52:00.454924 UTC"}
67712024-12-06T02:52:01.314ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
67722024-12-06T02:52:01.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67732024-12-06T02:52:01.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67742024-12-06T02:52:01.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67752024-12-06T02:52:01.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67762024-12-06T02:52:01.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67772024-12-06T02:52:01.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67782024-12-06T02:52:01.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67792024-12-06T02:52:01.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67802024-12-06T02:52:01.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67812024-12-06T02:52:01.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67822024-12-06T02:52:01.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67832024-12-06T02:52:01.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67842024-12-06T02:52:01.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 20f1fc2a-6679-4253-8e32-b08defdfebac roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
67852024-12-06T02:52:01.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 20f1fc2a-6679-4253-8e32-b08defdfebac resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
67862024-12-06T02:52:01.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 20f1fc2a-6679-4253-8e32-b08defdfebac response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
67872024-12-06T02:52:01.423ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 108.822968ms iteration = 25 status = {"physical_disks_added":0}
67882024-12-06T02:52:01.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 8f4d53dc-531f-48e4-b780-8fad4a673577 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
67892024-12-06T02:52:01.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 8f4d53dc-531f-48e4-b780-8fad4a673577 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
67902024-12-06T02:52:01.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 8f4d53dc-531f-48e4-b780-8fad4a673577 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
67912024-12-06T02:52:01.915ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47229
67922024-12-06T02:52:01.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47229 req_id = 187deeee-92da-4dab-8a8e-8dd506a6c5e5 roles = RoleSet { roles: {} } uri = /metrics/producers
67932024-12-06T02:52:01.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47229 req_id = 187deeee-92da-4dab-8a8e-8dd506a6c5e5 resource = Database result = Ok(()) uri = /metrics/producers
67942024-12-06T02:52:01.958ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 51153a4a-2459-4cf7-8ef8-603fcdf9d4a3
67952024-12-06T02:52:01.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42310 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47229 req_id = 187deeee-92da-4dab-8a8e-8dd506a6c5e5 response_code = 201 uri = /metrics/producers
67962024-12-06T02:52:02.019ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46945
67972024-12-06T02:52:02.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46945 req_id = 7684b343-72e1-4980-9fd1-d7916902bddc roles = RoleSet { roles: {} } uri = /metrics/producers
67982024-12-06T02:52:02.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46945 req_id = 7684b343-72e1-4980-9fd1-d7916902bddc resource = Database result = Ok(()) uri = /metrics/producers
67992024-12-06T02:52:02.062ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
68002024-12-06T02:52:02.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43304 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46945 req_id = 7684b343-72e1-4980-9fd1-d7916902bddc response_code = 201 uri = /metrics/producers
68012024-12-06T02:52:02.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc696375-5f00-4c01-8142-146733fbf2c5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68022024-12-06T02:52:02.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc696375-5f00-4c01-8142-146733fbf2c5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68032024-12-06T02:52:02.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc696375-5f00-4c01-8142-146733fbf2c5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68042024-12-06T02:52:03.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 06b75007-603f-4b0b-9a03-7699c986c2cd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68052024-12-06T02:52:03.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 06b75007-603f-4b0b-9a03-7699c986c2cd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68062024-12-06T02:52:03.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 06b75007-603f-4b0b-9a03-7699c986c2cd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68072024-12-06T02:52:03.529ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38902
68082024-12-06T02:52:03.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38902 req_id = bdfadee4-42df-431a-97b9-9908a202672a roles = RoleSet { roles: {} } uri = /metrics/producers
68092024-12-06T02:52:03.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38902 req_id = bdfadee4-42df-431a-97b9-9908a202672a resource = Database result = Ok(()) uri = /metrics/producers
68102024-12-06T02:52:03.604ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 37960cb7-3354-4d05-b7eb-4cf4f416256d
68112024-12-06T02:52:03.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75645 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38902 req_id = bdfadee4-42df-431a-97b9-9908a202672a response_code = 201 uri = /metrics/producers
68122024-12-06T02:52:04.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b946af9-fc13-4ae7-9809-d1de0d9d4be7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68132024-12-06T02:52:04.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b946af9-fc13-4ae7-9809-d1de0d9d4be7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68142024-12-06T02:52:04.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b946af9-fc13-4ae7-9809-d1de0d9d4be7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68152024-12-06T02:52:05.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = a320b03d-b630-45c4-a754-65b68e03fa8e response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
68162024-12-06T02:52:05.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 438c37c0-8ba4-4efe-a79d-9bf4561d7130 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68172024-12-06T02:52:05.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 438c37c0-8ba4-4efe-a79d-9bf4561d7130 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68182024-12-06T02:52:05.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 438c37c0-8ba4-4efe-a79d-9bf4561d7130 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68192024-12-06T02:52:06.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 79a2f1c9-7600-4ac1-9d36-0043952849eb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68202024-12-06T02:52:06.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 79a2f1c9-7600-4ac1-9d36-0043952849eb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68212024-12-06T02:52:06.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 79a2f1c9-7600-4ac1-9d36-0043952849eb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68222024-12-06T02:52:07.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 388fc599-812a-4843-a1f7-e2f22f7e3412 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68232024-12-06T02:52:07.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 388fc599-812a-4843-a1f7-e2f22f7e3412 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68242024-12-06T02:52:07.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 388fc599-812a-4843-a1f7-e2f22f7e3412 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68252024-12-06T02:52:08.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1bae2052-eae1-46cb-9b74-1e87b3b45dcd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68262024-12-06T02:52:08.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1bae2052-eae1-46cb-9b74-1e87b3b45dcd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68272024-12-06T02:52:08.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1bae2052-eae1-46cb-9b74-1e87b3b45dcd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68282024-12-06T02:52:09.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 70607630-8889-4c3d-ac45-18ba6c3b1579 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68292024-12-06T02:52:09.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 70607630-8889-4c3d-ac45-18ba6c3b1579 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68302024-12-06T02:52:09.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 70607630-8889-4c3d-ac45-18ba6c3b1579 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68312024-12-06T02:52:10.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
68322024-12-06T02:52:10.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68332024-12-06T02:52:10.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
68342024-12-06T02:52:10.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68352024-12-06T02:52:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68362024-12-06T02:52:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68372024-12-06T02:52:10.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382024-12-06T02:52:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68392024-12-06T02:52:10.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68402024-12-06T02:52:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68412024-12-06T02:52:10.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68422024-12-06T02:52:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68432024-12-06T02:52:10.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68442024-12-06T02:52:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
68452024-12-06T02:52:10.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68462024-12-06T02:52:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68472024-12-06T02:52:10.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
68482024-12-06T02:52:10.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.042546ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
68492024-12-06T02:52:10.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68502024-12-06T02:52:10.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68512024-12-06T02:52:10.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.311059ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68522024-12-06T02:52:10.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 707ed1fc-6ac9-443f-b26d-b695a59661a4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68532024-12-06T02:52:10.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 707ed1fc-6ac9-443f-b26d-b695a59661a4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68542024-12-06T02:52:10.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 707ed1fc-6ac9-443f-b26d-b695a59661a4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68552024-12-06T02:52:11.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f2ff3c9f-ebd7-488f-85f8-956ecb198b12 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68562024-12-06T02:52:11.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f2ff3c9f-ebd7-488f-85f8-956ecb198b12 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68572024-12-06T02:52:11.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f2ff3c9f-ebd7-488f-85f8-956ecb198b12 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68582024-12-06T02:52:12.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afb4ccb2-659b-4515-b105-1ca082434a38 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68592024-12-06T02:52:12.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afb4ccb2-659b-4515-b105-1ca082434a38 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68602024-12-06T02:52:12.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = afb4ccb2-659b-4515-b105-1ca082434a38 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68612024-12-06T02:52:13.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d044e528-36a3-4076-b589-71188998efb3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68622024-12-06T02:52:13.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d044e528-36a3-4076-b589-71188998efb3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68632024-12-06T02:52:13.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d044e528-36a3-4076-b589-71188998efb3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68642024-12-06T02:52:14.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2eebcad2-4123-4d30-bef5-c8d8d0aaacd1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68652024-12-06T02:52:14.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2eebcad2-4123-4d30-bef5-c8d8d0aaacd1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68662024-12-06T02:52:14.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2eebcad2-4123-4d30-bef5-c8d8d0aaacd1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68672024-12-06T02:52:15.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 3d2c015b-f38b-4fa4-93bd-cc1879d9b27b roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
68682024-12-06T02:52:15.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 3d2c015b-f38b-4fa4-93bd-cc1879d9b27b resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
68692024-12-06T02:52:15.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 3d2c015b-f38b-4fa4-93bd-cc1879d9b27b response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
68702024-12-06T02:52:15.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = d879c6cb-65a2-4505-9124-1f9c6a289596 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
68712024-12-06T02:52:15.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = d879c6cb-65a2-4505-9124-1f9c6a289596 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
68722024-12-06T02:52:15.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = d879c6cb-65a2-4505-9124-1f9c6a289596 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
68732024-12-06T02:52:15.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 6502e679-abeb-4a3b-be3d-5d5552d3ea20 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
68742024-12-06T02:52:15.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0a91b2dd-84ca-4813-bd0e-517e1320f676 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68752024-12-06T02:52:15.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0a91b2dd-84ca-4813-bd0e-517e1320f676 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68762024-12-06T02:52:15.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0a91b2dd-84ca-4813-bd0e-517e1320f676 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68772024-12-06T02:52:16.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 23873c96-a2ca-44a8-82fb-113c5ee74ae3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68782024-12-06T02:52:16.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 23873c96-a2ca-44a8-82fb-113c5ee74ae3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68792024-12-06T02:52:16.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 23873c96-a2ca-44a8-82fb-113c5ee74ae3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68802024-12-06T02:52:17.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 63a554ec-ad14-49af-943d-45bcf841a1c1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68812024-12-06T02:52:17.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 63a554ec-ad14-49af-943d-45bcf841a1c1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68822024-12-06T02:52:17.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 63a554ec-ad14-49af-943d-45bcf841a1c1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68832024-12-06T02:52:17.959ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35995
68842024-12-06T02:52:17.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35995 req_id = ef26ad8f-6798-4784-84aa-1a022ad9b640 roles = RoleSet { roles: {} } uri = /metrics/producers
68852024-12-06T02:52:17.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35995 req_id = ef26ad8f-6798-4784-84aa-1a022ad9b640 resource = Database result = Ok(()) uri = /metrics/producers
68862024-12-06T02:52:17.969ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 2dbba7e1-9c13-427e-a69e-72040b07d167
68872024-12-06T02:52:17.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10372 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35995 req_id = ef26ad8f-6798-4784-84aa-1a022ad9b640 response_code = 201 uri = /metrics/producers
68882024-12-06T02:52:18.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ea0aff60-2e29-4642-aba3-943cb8663b96 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68892024-12-06T02:52:18.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ea0aff60-2e29-4642-aba3-943cb8663b96 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68902024-12-06T02:52:18.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ea0aff60-2e29-4642-aba3-943cb8663b96 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68912024-12-06T02:52:19.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c8b50dc-907e-410c-9b53-38607ad4354c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68922024-12-06T02:52:19.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c8b50dc-907e-410c-9b53-38607ad4354c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68932024-12-06T02:52:19.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0c8b50dc-907e-410c-9b53-38607ad4354c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
68942024-12-06T02:52:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
68952024-12-06T02:52:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
68962024-12-06T02:52:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68972024-12-06T02:52:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68982024-12-06T02:52:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68992024-12-06T02:52:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69002024-12-06T02:52:20.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69012024-12-06T02:52:20.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69022024-12-06T02:52:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69032024-12-06T02:52:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69042024-12-06T02:52:20.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69052024-12-06T02:52:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69062024-12-06T02:52:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69072024-12-06T02:52:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69082024-12-06T02:52:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69092024-12-06T02:52:20.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
69102024-12-06T02:52:20.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69112024-12-06T02:52:20.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69122024-12-06T02:52:20.118ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
69132024-12-06T02:52:20.118ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.796908ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
69142024-12-06T02:52:20.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.781929ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69152024-12-06T02:52:20.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb63dedb-8a73-4976-8530-5b276f0ac108 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69162024-12-06T02:52:20.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb63dedb-8a73-4976-8530-5b276f0ac108 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69172024-12-06T02:52:20.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb63dedb-8a73-4976-8530-5b276f0ac108 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69182024-12-06T02:52:21.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fc6095c8-4ed3-4de4-be97-e9d4ecc73923 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69192024-12-06T02:52:21.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fc6095c8-4ed3-4de4-be97-e9d4ecc73923 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69202024-12-06T02:52:21.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fc6095c8-4ed3-4de4-be97-e9d4ecc73923 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69212024-12-06T02:52:22.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e0c63cb9-9ed2-4d33-a1fd-fea53726ecc7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69222024-12-06T02:52:22.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e0c63cb9-9ed2-4d33-a1fd-fea53726ecc7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69232024-12-06T02:52:22.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e0c63cb9-9ed2-4d33-a1fd-fea53726ecc7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69242024-12-06T02:52:23.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4db5fdbc-9a3f-4f1a-929c-e614e1f9d4c4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69252024-12-06T02:52:23.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4db5fdbc-9a3f-4f1a-929c-e614e1f9d4c4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69262024-12-06T02:52:23.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4db5fdbc-9a3f-4f1a-929c-e614e1f9d4c4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69272024-12-06T02:52:24.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 11f590b0-0804-4c9e-918e-a848fb4bd219 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69282024-12-06T02:52:24.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 11f590b0-0804-4c9e-918e-a848fb4bd219 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69292024-12-06T02:52:24.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 11f590b0-0804-4c9e-918e-a848fb4bd219 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69302024-12-06T02:52:25.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1582 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 7c2300cb-73c4-49f6-ab63-2b4ea1dac3df response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
69312024-12-06T02:52:25.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 18df82bc-2b2a-4f2b-aac3-ecd5ad5d56c1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69322024-12-06T02:52:25.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 18df82bc-2b2a-4f2b-aac3-ecd5ad5d56c1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69332024-12-06T02:52:25.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 18df82bc-2b2a-4f2b-aac3-ecd5ad5d56c1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69342024-12-06T02:52:26.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8bcbf24e-dec6-4d4e-9c71-906b2b0a7cb8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69352024-12-06T02:52:26.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8bcbf24e-dec6-4d4e-9c71-906b2b0a7cb8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69362024-12-06T02:52:26.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8bcbf24e-dec6-4d4e-9c71-906b2b0a7cb8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69372024-12-06T02:52:27.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a1de0e75-d65b-40eb-8d6d-e9751d52b523 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69382024-12-06T02:52:27.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a1de0e75-d65b-40eb-8d6d-e9751d52b523 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69392024-12-06T02:52:27.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a1de0e75-d65b-40eb-8d6d-e9751d52b523 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69402024-12-06T02:52:28.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c63c914e-b8dd-4ecf-973f-43b458a35094 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69412024-12-06T02:52:28.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c63c914e-b8dd-4ecf-973f-43b458a35094 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69422024-12-06T02:52:28.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c63c914e-b8dd-4ecf-973f-43b458a35094 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69432024-12-06T02:52:29.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d9951e6e-389a-46c6-941d-6850e3ce28d9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69442024-12-06T02:52:29.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d9951e6e-389a-46c6-941d-6850e3ce28d9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69452024-12-06T02:52:29.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d9951e6e-389a-46c6-941d-6850e3ce28d9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
69462024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
69472024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
69482024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69492024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69502024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
69512024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
69522024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69532024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
69542024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69552024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
69562024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
69572024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69582024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69592024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69602024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
69612024-12-06T02:52:30.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69622024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69632024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
69642024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69652024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
69662024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69672024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
69682024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69692024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
69702024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69712024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
69722024-12-06T02:52:30.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69732024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69742024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69752024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69762024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69772024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69782024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69792024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69802024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69812024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69822024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69832024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69842024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69852024-12-06T02:52:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
69862024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69872024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
69882024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69892024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69902024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
69912024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69922024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
69932024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69942024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69952024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69962024-12-06T02:52:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69972024-12-06T02:52:30.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69982024-12-06T02:52:30.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69992024-12-06T02:52:30.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70002024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70012024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70022024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70032024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70042024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70052024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70062024-12-06T02:52:30.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70072024-12-06T02:52:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70082024-12-06T02:52:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70092024-12-06T02:52:30.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70102024-12-06T02:52:30.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70112024-12-06T02:52:30.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122024-12-06T02:52:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70132024-12-06T02:52:30.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70142024-12-06T02:52:30.113ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.796666ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70152024-12-06T02:52:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70162024-12-06T02:52:30.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6298, tv_nsec: 482321850 } })
70172024-12-06T02:52:30.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6298, tv_nsec: 482349070 } })
70182024-12-06T02:52:30.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
70192024-12-06T02:52:30.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
70202024-12-06T02:52:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70212024-12-06T02:52:30.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70222024-12-06T02:52:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70232024-12-06T02:52:30.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70242024-12-06T02:52:30.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70252024-12-06T02:52:30.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70262024-12-06T02:52:30.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70272024-12-06T02:52:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70282024-12-06T02:52:30.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70292024-12-06T02:52:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70302024-12-06T02:52:30.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70312024-12-06T02:52:30.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70322024-12-06T02:52:30.129ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6298, tv_nsec: 497156923 } })
70332024-12-06T02:52:30.129ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
70342024-12-06T02:52:30.171ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70352024-12-06T02:52:30.171ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70362024-12-06T02:52:30.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70372024-12-06T02:52:30.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70382024-12-06T02:52:30.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70392024-12-06T02:52:30.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70402024-12-06T02:52:30.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70412024-12-06T02:52:30.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70422024-12-06T02:52:30.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70432024-12-06T02:52:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
70442024-12-06T02:52:30.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70452024-12-06T02:52:30.178ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70462024-12-06T02:52:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70472024-12-06T02:52:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70482024-12-06T02:52:30.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70492024-12-06T02:52:30.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502024-12-06T02:52:30.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70512024-12-06T02:52:30.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70522024-12-06T02:52:30.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70532024-12-06T02:52:30.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70542024-12-06T02:52:30.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70552024-12-06T02:52:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70562024-12-06T02:52:30.183ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70572024-12-06T02:52:30.183ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.073081ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70582024-12-06T02:52:30.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70592024-12-06T02:52:30.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70602024-12-06T02:52:30.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70612024-12-06T02:52:30.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
70622024-12-06T02:52:30.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70632024-12-06T02:52:30.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70642024-12-06T02:52:30.193ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.12795ms iteration = 22 status = 0
70652024-12-06T02:52:30.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.542652ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
70662024-12-06T02:52:30.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 97.131603ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
70672024-12-06T02:52:30.201ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
70682024-12-06T02:52:30.201ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.647144ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
70692024-12-06T02:52:30.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70702024-12-06T02:52:30.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70712024-12-06T02:52:30.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70722024-12-06T02:52:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70732024-12-06T02:52:30.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70742024-12-06T02:52:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70752024-12-06T02:52:30.217ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70762024-12-06T02:52:30.217ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70772024-12-06T02:52:30.218ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9ea81ae-bc44-4d29-ab08-8da115188f7b", "content-length": "26", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
70782024-12-06T02:52:30.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70792024-12-06T02:52:30.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70802024-12-06T02:52:30.218ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70812024-12-06T02:52:30.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.633469ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70822024-12-06T02:52:30.218ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0309167c-48bf-4931-b87b-adfc78437af4", "content-length": "26", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
70832024-12-06T02:52:30.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70842024-12-06T02:52:30.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70852024-12-06T02:52:30.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70862024-12-06T02:52:30.223ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70872024-12-06T02:52:30.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70882024-12-06T02:52:30.225ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
70892024-12-06T02:52:30.225ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70902024-12-06T02:52:30.226ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25cbd240-65fa-4117-bd57-b452470e3a88", "content-length": "26", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
70912024-12-06T02:52:30.226ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70922024-12-06T02:52:30.226ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70932024-12-06T02:52:30.226ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70942024-12-06T02:52:30.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70952024-12-06T02:52:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70962024-12-06T02:52:30.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
70972024-12-06T02:52:30.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.287605ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70982024-12-06T02:52:30.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 142.344675ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70992024-12-06T02:52:30.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 172.780234ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
71002024-12-06T02:52:30.279ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71012024-12-06T02:52:30.279ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71022024-12-06T02:52:30.279ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.131526ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71032024-12-06T02:52:30.299ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.653333ms iteration = 26 status = {"physical_disks_added":0}
71042024-12-06T02:52:30.325ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71052024-12-06T02:52:30.326ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3828dd67-5134-4e88-8a1b-0eb4830265a2", "content-length": "1", "date": "Fri, 06 Dec 2024 02:52:29 GMT"} })
71062024-12-06T02:52:30.328ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71072024-12-06T02:52:30.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71082024-12-06T02:52:30.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71092024-12-06T02:52:30.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71102024-12-06T02:52:30.330ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.132184ms iteration = 22 status = null
71112024-12-06T02:52:30.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71122024-12-06T02:52:30.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71132024-12-06T02:52:30.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71142024-12-06T02:52:30.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71152024-12-06T02:52:30.341ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 240.389626ms iteration = 22 status = {}
71162024-12-06T02:52:30.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71172024-12-06T02:52:30.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71182024-12-06T02:52:30.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71192024-12-06T02:52:30.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71202024-12-06T02:52:30.367ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71212024-12-06T02:52:30.367ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71222024-12-06T02:52:30.367ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fdc4f7a-6580-47fe-8b9c-26fa65f3c2a7", "content-length": "372", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
71232024-12-06T02:52:30.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71242024-12-06T02:52:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71252024-12-06T02:52:30.411ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71262024-12-06T02:52:30.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71272024-12-06T02:52:30.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3f2e5627-9800-4419-a7c6-e971ebca0605", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
71282024-12-06T02:52:30.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71292024-12-06T02:52:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71302024-12-06T02:52:30.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71312024-12-06T02:52:30.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71322024-12-06T02:52:30.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71332024-12-06T02:52:30.431ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a95de259-6d73-43de-99bc-b9bb9627ea7f", "content-length": "691", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
71342024-12-06T02:52:30.431ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
71352024-12-06T02:52:30.431ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
71362024-12-06T02:52:30.431ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
71372024-12-06T02:52:30.433ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.836656ms iteration = 22 status = {}
71382024-12-06T02:52:30.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71392024-12-06T02:52:30.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71402024-12-06T02:52:30.438ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71412024-12-06T02:52:30.438ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71422024-12-06T02:52:30.438ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b194e9f2-8add-4e28-bfc7-01b367aaf333", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
71432024-12-06T02:52:30.440ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 339.225568ms iteration = 23 status = {}
71442024-12-06T02:52:30.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71452024-12-06T02:52:30.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71462024-12-06T02:52:30.451ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
71472024-12-06T02:52:30.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71482024-12-06T02:52:30.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71492024-12-06T02:52:30.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71502024-12-06T02:52:30.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4227032-5076-46a9-9ce8-d890d872b8e5", "content-length": "134", "date": "Fri, 06 Dec 2024 02:52:29 GMT"} })
71512024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71522024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
71532024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71542024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71552024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71562024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71572024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71582024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71592024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71602024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71612024-12-06T02:52:30.461ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
71622024-12-06T02:52:30.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71632024-12-06T02:52:30.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71642024-12-06T02:52:30.463ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71652024-12-06T02:52:30.463ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "11af6818-4db3-46fd-ac77-892dd0bcc5be", "content-length": "2", "date": "Fri, 06 Dec 2024 02:52:29 GMT"} })
71662024-12-06T02:52:30.463ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71672024-12-06T02:52:30.463ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5467e1e8-8f88-4db3-a224-30e85a372db2", "content-length": "52", "date": "Fri, 06 Dec 2024 02:52:29 GMT"} })
71682024-12-06T02:52:30.463ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
71692024-12-06T02:52:30.463ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71702024-12-06T02:52:30.637ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4beb92cd-ed35-4cb9-8b05-30ea57343365", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
71712024-12-06T02:52:30.637ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
71722024-12-06T02:52:30.637ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71732024-12-06T02:52:30.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c881dc1d-b659-4d1b-83d0-51f5b26e7bd5", "content-length": "682", "date": "Fri, 06 Dec 2024 02:52:30 GMT"} })
71742024-12-06T02:52:30.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71752024-12-06T02:52:30.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71762024-12-06T02:52:30.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71772024-12-06T02:52:30.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71782024-12-06T02:52:30.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71792024-12-06T02:52:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71802024-12-06T02:52:30.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71812024-12-06T02:52:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71822024-12-06T02:52:30.653ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 552.698796ms iteration = 22 status = {}
71832024-12-06T02:52:30.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5966b30-41fd-4b6b-ab9e-6839fdcf36e3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
71842024-12-06T02:52:30.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5966b30-41fd-4b6b-ab9e-6839fdcf36e3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
71852024-12-06T02:52:30.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5966b30-41fd-4b6b-ab9e-6839fdcf36e3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
71862024-12-06T02:52:31.534ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
71872024-12-06T02:52:31.534ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
71882024-12-06T02:52:31.564ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
71892024-12-06T02:52:31.564ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:58359
71902024-12-06T02:52:31.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58359 req_id = bd1aaf52-b7fc-4cad-9211-81ed4c84029b roles = RoleSet { roles: {} } uri = /metrics/producers
71912024-12-06T02:52:31.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58359 req_id = bd1aaf52-b7fc-4cad-9211-81ed4c84029b resource = Database result = Ok(()) uri = /metrics/producers
71922024-12-06T02:52:31.600ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3943088e-6ce0-4ada-925c-494df92c0dda
71932024-12-06T02:52:31.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35502 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58359 req_id = bd1aaf52-b7fc-4cad-9211-81ed4c84029b response_code = 201 uri = /metrics/producers
71942024-12-06T02:52:31.600ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bd1aaf52-b7fc-4cad-9211-81ed4c84029b", "content-length": "41", "date": "Fri, 06 Dec 2024 02:52:31 GMT"} })
71952024-12-06T02:52:31.601ZDEBGnexus (producer-registration-task): registered with nexus successfully
71962024-12-06T02:52:31.601ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
71972024-12-06T02:52:31.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 69a2c298-d5f9-46ad-ba90-ad83b1261af3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
71982024-12-06T02:52:31.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 69a2c298-d5f9-46ad-ba90-ad83b1261af3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
71992024-12-06T02:52:31.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 69a2c298-d5f9-46ad-ba90-ad83b1261af3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
72002024-12-06T02:52:32.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e803e731-0229-4a08-97b6-32246f880e82 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72012024-12-06T02:52:32.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e803e731-0229-4a08-97b6-32246f880e82 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72022024-12-06T02:52:32.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e803e731-0229-4a08-97b6-32246f880e82 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72032024-12-06T02:52:33.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5c2441c9-9511-44eb-b6fa-830859cde087 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72042024-12-06T02:52:33.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5c2441c9-9511-44eb-b6fa-830859cde087 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72052024-12-06T02:52:33.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5c2441c9-9511-44eb-b6fa-830859cde087 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72062024-12-06T02:52:34.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5a5b95c4-2d27-4eb8-9b32-2ca1655a2abd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72072024-12-06T02:52:34.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5a5b95c4-2d27-4eb8-9b32-2ca1655a2abd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72082024-12-06T02:52:34.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5a5b95c4-2d27-4eb8-9b32-2ca1655a2abd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72092024-12-06T02:52:35.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1356 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 296441de-4723-4b0a-8746-e623f9e6c631 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
72102024-12-06T02:52:35.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f012ae5b-1a32-4641-8a8d-d60320b0f1e5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72112024-12-06T02:52:35.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f012ae5b-1a32-4641-8a8d-d60320b0f1e5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72122024-12-06T02:52:35.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f012ae5b-1a32-4641-8a8d-d60320b0f1e5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72132024-12-06T02:52:36.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f8322bb1-266e-4bc9-9388-8755df04e877 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72142024-12-06T02:52:36.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f8322bb1-266e-4bc9-9388-8755df04e877 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72152024-12-06T02:52:36.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f8322bb1-266e-4bc9-9388-8755df04e877 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72162024-12-06T02:52:37.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5131827a-68ad-4da2-9998-31089532b19a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72172024-12-06T02:52:37.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5131827a-68ad-4da2-9998-31089532b19a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72182024-12-06T02:52:37.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5131827a-68ad-4da2-9998-31089532b19a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72192024-12-06T02:52:38.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fe4582a7-dd27-4ada-a02b-ecdc32b5e32a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72202024-12-06T02:52:38.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fe4582a7-dd27-4ada-a02b-ecdc32b5e32a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72212024-12-06T02:52:38.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fe4582a7-dd27-4ada-a02b-ecdc32b5e32a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72222024-12-06T02:52:39.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50c6dca4-2c59-41a0-89ff-12f597f1760f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72232024-12-06T02:52:39.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50c6dca4-2c59-41a0-89ff-12f597f1760f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72242024-12-06T02:52:39.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 50c6dca4-2c59-41a0-89ff-12f597f1760f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72252024-12-06T02:52:40.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
72262024-12-06T02:52:40.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
72272024-12-06T02:52:40.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72282024-12-06T02:52:40.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72292024-12-06T02:52:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72302024-12-06T02:52:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72312024-12-06T02:52:40.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72322024-12-06T02:52:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72332024-12-06T02:52:40.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72342024-12-06T02:52:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72352024-12-06T02:52:40.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72362024-12-06T02:52:40.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72372024-12-06T02:52:40.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72382024-12-06T02:52:40.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72392024-12-06T02:52:40.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72402024-12-06T02:52:40.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
72412024-12-06T02:52:40.140ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72422024-12-06T02:52:40.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72432024-12-06T02:52:40.149ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
72442024-12-06T02:52:40.149ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.966378ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
72452024-12-06T02:52:40.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.247376ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72462024-12-06T02:52:40.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 530c8de6-b75b-4db4-a9fb-57e63a7e740c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72472024-12-06T02:52:40.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 530c8de6-b75b-4db4-a9fb-57e63a7e740c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72482024-12-06T02:52:40.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 530c8de6-b75b-4db4-a9fb-57e63a7e740c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72492024-12-06T02:52:41.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d5bf6de2-68df-4fe6-b8ed-78cc0f0b6af9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72502024-12-06T02:52:41.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d5bf6de2-68df-4fe6-b8ed-78cc0f0b6af9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72512024-12-06T02:52:41.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d5bf6de2-68df-4fe6-b8ed-78cc0f0b6af9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72522024-12-06T02:52:42.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 114550c2-2d90-4a30-8525-c570bc2e6abe roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72532024-12-06T02:52:42.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 114550c2-2d90-4a30-8525-c570bc2e6abe resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72542024-12-06T02:52:42.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 114550c2-2d90-4a30-8525-c570bc2e6abe response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72552024-12-06T02:52:43.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1dcf172e-1361-43ff-a6e7-4817e73ea1a4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72562024-12-06T02:52:43.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1dcf172e-1361-43ff-a6e7-4817e73ea1a4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72572024-12-06T02:52:43.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1dcf172e-1361-43ff-a6e7-4817e73ea1a4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72582024-12-06T02:52:44.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5e2080c-cdd0-4793-a501-0b5aaa28a6e4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72592024-12-06T02:52:44.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5e2080c-cdd0-4793-a501-0b5aaa28a6e4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72602024-12-06T02:52:44.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a5e2080c-cdd0-4793-a501-0b5aaa28a6e4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72612024-12-06T02:52:45.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 6b924dcb-98ab-477e-ad6d-1e1dcebc295e roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
72622024-12-06T02:52:45.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 6b924dcb-98ab-477e-ad6d-1e1dcebc295e resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
72632024-12-06T02:52:45.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 6b924dcb-98ab-477e-ad6d-1e1dcebc295e response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
72642024-12-06T02:52:45.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 0b242c6a-2b6f-4a72-a552-e3fb28ac65f7 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
72652024-12-06T02:52:45.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 0b242c6a-2b6f-4a72-a552-e3fb28ac65f7 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
72662024-12-06T02:52:45.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 0b242c6a-2b6f-4a72-a552-e3fb28ac65f7 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
72672024-12-06T02:52:45.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1150 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 26b09c85-e917-4754-a9e9-14e3dde4a4f4 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
72682024-12-06T02:52:45.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a423e83a-378a-4376-b7d1-4083873129ec roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72692024-12-06T02:52:45.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a423e83a-378a-4376-b7d1-4083873129ec resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72702024-12-06T02:52:45.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a423e83a-378a-4376-b7d1-4083873129ec response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72712024-12-06T02:52:46.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 166fea95-a7f7-48a5-ab75-38c4b2118aef roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72722024-12-06T02:52:46.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 166fea95-a7f7-48a5-ab75-38c4b2118aef resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72732024-12-06T02:52:46.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 166fea95-a7f7-48a5-ab75-38c4b2118aef response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72742024-12-06T02:52:47.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4733115e-dbe5-433c-a08d-878009509986 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72752024-12-06T02:52:47.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4733115e-dbe5-433c-a08d-878009509986 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72762024-12-06T02:52:47.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4733115e-dbe5-433c-a08d-878009509986 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72772024-12-06T02:52:48.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7f0ee3d1-0767-4b70-a5d7-1e9d75674ab6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72782024-12-06T02:52:48.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7f0ee3d1-0767-4b70-a5d7-1e9d75674ab6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72792024-12-06T02:52:48.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7f0ee3d1-0767-4b70-a5d7-1e9d75674ab6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72802024-12-06T02:52:49.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a4d364c-07aa-418f-a53d-ea650f5c9c4c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72812024-12-06T02:52:49.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a4d364c-07aa-418f-a53d-ea650f5c9c4c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72822024-12-06T02:52:49.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a4d364c-07aa-418f-a53d-ea650f5c9c4c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
72832024-12-06T02:52:50.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
72842024-12-06T02:52:50.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
72852024-12-06T02:52:50.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72862024-12-06T02:52:50.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72872024-12-06T02:52:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72882024-12-06T02:52:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72892024-12-06T02:52:50.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72902024-12-06T02:52:50.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72912024-12-06T02:52:50.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72922024-12-06T02:52:50.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.009564ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72932024-12-06T02:52:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72942024-12-06T02:52:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72952024-12-06T02:52:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72962024-12-06T02:52:50.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72972024-12-06T02:52:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72982024-12-06T02:52:50.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72992024-12-06T02:52:50.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
73002024-12-06T02:52:50.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73012024-12-06T02:52:50.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73022024-12-06T02:52:50.151ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
73032024-12-06T02:52:50.151ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.621085ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
73042024-12-06T02:52:50.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 06317eeb-c977-4dc5-84cd-1bf5c8ac66fa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73052024-12-06T02:52:50.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 06317eeb-c977-4dc5-84cd-1bf5c8ac66fa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73062024-12-06T02:52:50.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 06317eeb-c977-4dc5-84cd-1bf5c8ac66fa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73072024-12-06T02:52:51.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d25f2d87-05c2-4a47-9b53-b3514c5aaf67 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73082024-12-06T02:52:51.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d25f2d87-05c2-4a47-9b53-b3514c5aaf67 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73092024-12-06T02:52:51.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d25f2d87-05c2-4a47-9b53-b3514c5aaf67 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73102024-12-06T02:52:52.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64b2d07c-0f14-4fc7-b195-bbb1815ceb28 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73112024-12-06T02:52:52.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64b2d07c-0f14-4fc7-b195-bbb1815ceb28 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73122024-12-06T02:52:52.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 64b2d07c-0f14-4fc7-b195-bbb1815ceb28 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73132024-12-06T02:52:53.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92f29104-a635-4e05-bb62-74e9cbb55a22 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73142024-12-06T02:52:53.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92f29104-a635-4e05-bb62-74e9cbb55a22 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73152024-12-06T02:52:53.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92f29104-a635-4e05-bb62-74e9cbb55a22 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73162024-12-06T02:52:54.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fe9f4085-a872-41b7-a86b-a9578af27c7d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73172024-12-06T02:52:54.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fe9f4085-a872-41b7-a86b-a9578af27c7d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73182024-12-06T02:52:54.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fe9f4085-a872-41b7-a86b-a9578af27c7d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73192024-12-06T02:52:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1291 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 7e2a202d-c4bc-4040-9c19-642b8b0aaa6c response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
73202024-12-06T02:52:55.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28c7d7d2-92fd-4188-ba99-d7d762c5833d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73212024-12-06T02:52:55.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28c7d7d2-92fd-4188-ba99-d7d762c5833d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73222024-12-06T02:52:55.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28c7d7d2-92fd-4188-ba99-d7d762c5833d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73232024-12-06T02:52:56.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cfa0f31a-021d-4155-85ee-5df8e6d901eb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73242024-12-06T02:52:56.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cfa0f31a-021d-4155-85ee-5df8e6d901eb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73252024-12-06T02:52:56.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cfa0f31a-021d-4155-85ee-5df8e6d901eb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73262024-12-06T02:52:57.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8be20880-a2de-4211-93b8-a527716ad9e7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73272024-12-06T02:52:57.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8be20880-a2de-4211-93b8-a527716ad9e7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73282024-12-06T02:52:57.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8be20880-a2de-4211-93b8-a527716ad9e7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73292024-12-06T02:52:58.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = da16c183-2f1a-4a8d-addf-60273e92ec9b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73302024-12-06T02:52:58.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = da16c183-2f1a-4a8d-addf-60273e92ec9b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73312024-12-06T02:52:58.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = da16c183-2f1a-4a8d-addf-60273e92ec9b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73322024-12-06T02:52:59.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5f51b548-b72e-4024-8f32-5d9e4803a603 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73332024-12-06T02:52:59.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5f51b548-b72e-4024-8f32-5d9e4803a603 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73342024-12-06T02:52:59.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5f51b548-b72e-4024-8f32-5d9e4803a603 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
73352024-12-06T02:53:00.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = aa57db33-aa1c-441b-a231-219197761608 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
73362024-12-06T02:53:00.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = aa57db33-aa1c-441b-a231-219197761608 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
73372024-12-06T02:53:00.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = aa57db33-aa1c-441b-a231-219197761608 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
73382024-12-06T02:53:00.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = e05e8eb2-c62d-439c-8855-f228a48b6198 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
73392024-12-06T02:53:00.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = e05e8eb2-c62d-439c-8855-f228a48b6198 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
73402024-12-06T02:53:00.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = e05e8eb2-c62d-439c-8855-f228a48b6198 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
73412024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
73422024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
73432024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
73442024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73452024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73462024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
73472024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
73482024-12-06T02:53:00.100ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:43:00.100263023 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
73492024-12-06T02:53:00.100ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
73502024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
73512024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73522024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
73532024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
73542024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73552024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
73562024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73572024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
73582024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
73592024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73602024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73612024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
73622024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73632024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73642024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
73652024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73662024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
73672024-12-06T02:53:00.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73682024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73692024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
73702024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73712024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
73722024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
73732024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73742024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
73752024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
73762024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
73772024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
73782024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73792024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
73802024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
73812024-12-06T02:53:00.100ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
73822024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.22\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
73832024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
73842024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73852024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
73862024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73872024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
73882024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
73892024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73902024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73912024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73922024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73932024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73942024-12-06T02:53:00.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73952024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
73962024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73972024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73982024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73992024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74002024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74012024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74022024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74032024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74042024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74052024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74062024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
74072024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
74082024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74092024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
74102024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74112024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74122024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
74132024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
74142024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74152024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74162024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74172024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
74182024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74192024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74202024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74212024-12-06T02:53:00.101ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6328, tv_nsec: 469286294 } })
74222024-12-06T02:53:00.101ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6328, tv_nsec: 469286625 } })
74232024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74242024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74252024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74262024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
74272024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74282024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74292024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
74302024-12-06T02:53:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.39857ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
74312024-12-06T02:53:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
74322024-12-06T02:53:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.480772ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
74332024-12-06T02:53:00.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74342024-12-06T02:53:00.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74352024-12-06T02:53:00.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74362024-12-06T02:53:00.118ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 18.126628ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74372024-12-06T02:53:00.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74382024-12-06T02:53:00.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74392024-12-06T02:53:00.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74402024-12-06T02:53:00.124ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:43:00.100263023 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
74412024-12-06T02:53:00.124ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 23.84063ms iteration = 12 status = {"expiration":"2024-12-06T02:43:00.100263023Z","pruned":[]}
74422024-12-06T02:53:00.126ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6328, tv_nsec: 494289068 } })
74432024-12-06T02:53:00.126ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
74442024-12-06T02:53:00.127ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74452024-12-06T02:53:00.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74462024-12-06T02:53:00.130ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74472024-12-06T02:53:00.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74482024-12-06T02:53:00.132ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74492024-12-06T02:53:00.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74502024-12-06T02:53:00.134ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74512024-12-06T02:53:00.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74522024-12-06T02:53:00.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74532024-12-06T02:53:00.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74542024-12-06T02:53:00.136ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6328, tv_nsec: 504626363 } })
74552024-12-06T02:53:00.137ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
74562024-12-06T02:53:00.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74572024-12-06T02:53:00.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74582024-12-06T02:53:00.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74592024-12-06T02:53:00.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74602024-12-06T02:53:00.152ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74612024-12-06T02:53:00.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74622024-12-06T02:53:00.155ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74632024-12-06T02:53:00.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74642024-12-06T02:53:00.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74652024-12-06T02:53:00.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74662024-12-06T02:53:00.168ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 67.481107ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
74672024-12-06T02:53:00.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74682024-12-06T02:53:00.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74692024-12-06T02:53:00.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74702024-12-06T02:53:00.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74712024-12-06T02:53:00.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74722024-12-06T02:53:00.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74732024-12-06T02:53:00.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.872275ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74742024-12-06T02:53:00.206ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6328, tv_nsec: 574559871 } })
74752024-12-06T02:53:00.207ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
74762024-12-06T02:53:00.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772024-12-06T02:53:00.210ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74782024-12-06T02:53:00.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74792024-12-06T02:53:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74802024-12-06T02:53:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74812024-12-06T02:53:00.211ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74822024-12-06T02:53:00.211ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74832024-12-06T02:53:00.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74842024-12-06T02:53:00.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74852024-12-06T02:53:00.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74862024-12-06T02:53:00.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74872024-12-06T02:53:00.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74882024-12-06T02:53:00.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892024-12-06T02:53:00.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74902024-12-06T02:53:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74912024-12-06T02:53:00.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74922024-12-06T02:53:00.217ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74932024-12-06T02:53:00.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74942024-12-06T02:53:00.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
74952024-12-06T02:53:00.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74962024-12-06T02:53:00.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74972024-12-06T02:53:00.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74982024-12-06T02:53:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74992024-12-06T02:53:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75002024-12-06T02:53:00.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75012024-12-06T02:53:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
75022024-12-06T02:53:00.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75032024-12-06T02:53:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75042024-12-06T02:53:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75052024-12-06T02:53:00.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75062024-12-06T02:53:00.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75072024-12-06T02:53:00.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75082024-12-06T02:53:00.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75092024-12-06T02:53:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75102024-12-06T02:53:00.238ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75112024-12-06T02:53:00.238ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75122024-12-06T02:53:00.238ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 137.414805ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75132024-12-06T02:53:00.238ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75142024-12-06T02:53:00.238ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75152024-12-06T02:53:00.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75162024-12-06T02:53:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75172024-12-06T02:53:00.239ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
75182024-12-06T02:53:00.239ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
75192024-12-06T02:53:00.239ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 139.581856ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
75202024-12-06T02:53:00.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75212024-12-06T02:53:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75222024-12-06T02:53:00.249ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75232024-12-06T02:53:00.250ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 149.536821ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75242024-12-06T02:53:00.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75252024-12-06T02:53:00.253ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75262024-12-06T02:53:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75272024-12-06T02:53:00.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75282024-12-06T02:53:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75292024-12-06T02:53:00.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 157.748685ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
75302024-12-06T02:53:00.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75312024-12-06T02:53:00.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 170.198401ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
75322024-12-06T02:53:00.271ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
75332024-12-06T02:53:00.271ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 170.808538ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
75342024-12-06T02:53:00.273ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75352024-12-06T02:53:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75362024-12-06T02:53:00.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75372024-12-06T02:53:00.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75382024-12-06T02:53:00.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75392024-12-06T02:53:00.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 174.489753ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
75402024-12-06T02:53:00.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75412024-12-06T02:53:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75422024-12-06T02:53:00.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75432024-12-06T02:53:00.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75442024-12-06T02:53:00.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75452024-12-06T02:53:00.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
75462024-12-06T02:53:00.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75472024-12-06T02:53:00.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75482024-12-06T02:53:00.289ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 188.925655ms iteration = 23 status = 0
75492024-12-06T02:53:00.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 191.87131ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75502024-12-06T02:53:00.293ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
75512024-12-06T02:53:00.293ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
75522024-12-06T02:53:00.293ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
75532024-12-06T02:53:00.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75542024-12-06T02:53:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75552024-12-06T02:53:00.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75562024-12-06T02:53:00.296ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75572024-12-06T02:53:00.296ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75582024-12-06T02:53:00.297ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b979b49-12e6-4139-8856-632e81734428", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
75592024-12-06T02:53:00.297ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75602024-12-06T02:53:00.299ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75612024-12-06T02:53:00.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75622024-12-06T02:53:00.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75632024-12-06T02:53:00.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75642024-12-06T02:53:00.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75652024-12-06T02:53:00.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75662024-12-06T02:53:00.308ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
75672024-12-06T02:53:00.308ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
75682024-12-06T02:53:00.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75692024-12-06T02:53:00.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75702024-12-06T02:53:00.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712024-12-06T02:53:00.314ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75722024-12-06T02:53:00.314ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75732024-12-06T02:53:00.314ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 214.463074ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75742024-12-06T02:53:00.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75752024-12-06T02:53:00.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75762024-12-06T02:53:00.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75772024-12-06T02:53:00.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
75782024-12-06T02:53:00.318ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
75792024-12-06T02:53:00.318ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
75802024-12-06T02:53:00.318ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
75812024-12-06T02:53:00.318ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 218.718066ms iteration = 13 status = {"generation":2}
75822024-12-06T02:53:00.319ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
75832024-12-06T02:53:00.319ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
75842024-12-06T02:53:00.319ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
75852024-12-06T02:53:00.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75862024-12-06T02:53:00.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75872024-12-06T02:53:00.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882024-12-06T02:53:00.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75892024-12-06T02:53:00.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75902024-12-06T02:53:00.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75912024-12-06T02:53:00.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75922024-12-06T02:53:00.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75932024-12-06T02:53:00.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75942024-12-06T02:53:00.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75952024-12-06T02:53:00.330ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75962024-12-06T02:53:00.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75972024-12-06T02:53:00.356ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75982024-12-06T02:53:00.356ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75992024-12-06T02:53:00.356ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8c4bf91-3d4b-4591-96da-b5e38f74df59", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76002024-12-06T02:53:00.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76012024-12-06T02:53:00.358ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76022024-12-06T02:53:00.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 260.759877ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76032024-12-06T02:53:00.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76042024-12-06T02:53:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76052024-12-06T02:53:00.386ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
76062024-12-06T02:53:00.386ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
76072024-12-06T02:53:00.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76082024-12-06T02:53:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76092024-12-06T02:53:00.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
76102024-12-06T02:53:00.386ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76112024-12-06T02:53:00.386ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2da4fd1e-c63f-4e99-9720-f75213134414", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76122024-12-06T02:53:00.386ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76132024-12-06T02:53:00.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76142024-12-06T02:53:00.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
76152024-12-06T02:53:00.390ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
76162024-12-06T02:53:00.390ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 290.011913ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
76172024-12-06T02:53:00.391ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
76182024-12-06T02:53:00.391ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 291.249919ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
76192024-12-06T02:53:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76202024-12-06T02:53:00.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76212024-12-06T02:53:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76222024-12-06T02:53:00.395ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
76232024-12-06T02:53:00.395ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
76242024-12-06T02:53:00.395ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
76252024-12-06T02:53:00.395ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 295.201902ms iteration = 13 status = {"generation":1}
76262024-12-06T02:53:00.402ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 302.195171ms iteration = 27 status = {"physical_disks_added":0}
76272024-12-06T02:53:00.475ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76282024-12-06T02:53:00.476ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0dc0ceb-abdc-4944-8573-3e27e3407423", "content-length": "1", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76292024-12-06T02:53:00.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76302024-12-06T02:53:00.477ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
76312024-12-06T02:53:00.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76322024-12-06T02:53:00.478ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76332024-12-06T02:53:00.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76342024-12-06T02:53:00.490ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
76352024-12-06T02:53:00.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3e12ab63-0e09-4282-845e-aa51e6992b87", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76362024-12-06T02:53:00.490ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76372024-12-06T02:53:00.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bdeaf674-38e9-42b9-a76c-1054bfb54618", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76382024-12-06T02:53:00.492ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76392024-12-06T02:53:00.495ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
76402024-12-06T02:53:00.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 394.524539ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
76412024-12-06T02:53:00.514ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 413.780518ms iteration = 23 status = {}
76422024-12-06T02:53:00.536ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76432024-12-06T02:53:00.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76442024-12-06T02:53:00.536ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbc86a70-d1b5-45c3-bd03-0c2682c19c77", "content-length": "372", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76452024-12-06T02:53:00.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76462024-12-06T02:53:00.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76472024-12-06T02:53:00.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-12-06T02:53:00.539ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 439.263866ms iteration = 23 status = null
76492024-12-06T02:53:00.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76502024-12-06T02:53:00.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76512024-12-06T02:53:00.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76522024-12-06T02:53:00.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76532024-12-06T02:53:00.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76542024-12-06T02:53:00.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76552024-12-06T02:53:00.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76562024-12-06T02:53:00.587ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
76572024-12-06T02:53:00.587ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76582024-12-06T02:53:00.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0ffc1753-533f-44bc-9fe7-178687b1aa07", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76592024-12-06T02:53:00.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76602024-12-06T02:53:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76612024-12-06T02:53:00.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76622024-12-06T02:53:00.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76632024-12-06T02:53:00.591ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
76642024-12-06T02:53:00.591ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b2ebe844-b11a-43f7-aa91-de79ceadc07e", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76652024-12-06T02:53:00.591ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76662024-12-06T02:53:00.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76672024-12-06T02:53:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76682024-12-06T02:53:00.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "32595e11-334f-408a-89de-40b2e5206af4", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76692024-12-06T02:53:00.597ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76702024-12-06T02:53:00.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1f2f437e-a4c0-423c-86ad-0da050a95964", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76712024-12-06T02:53:00.599ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76722024-12-06T02:53:00.600ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76732024-12-06T02:53:00.600ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76742024-12-06T02:53:00.600ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d283f440-9b5b-40de-ae15-8a1fe1be94cf", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76752024-12-06T02:53:00.602ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76762024-12-06T02:53:00.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 501.993638ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
76772024-12-06T02:53:00.603ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 503.232543ms iteration = 24 status = {}
76782024-12-06T02:53:00.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 256ac747-e7aa-4a70-a4e3-4ff3bf93cde0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
76792024-12-06T02:53:00.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 256ac747-e7aa-4a70-a4e3-4ff3bf93cde0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
76802024-12-06T02:53:00.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 256ac747-e7aa-4a70-a4e3-4ff3bf93cde0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
76812024-12-06T02:53:00.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76822024-12-06T02:53:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76832024-12-06T02:53:00.759ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76842024-12-06T02:53:00.760ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
76852024-12-06T02:53:00.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76862024-12-06T02:53:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76872024-12-06T02:53:00.769ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76882024-12-06T02:53:00.769ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "121ce709-b99a-4461-b416-3545f8fed833", "content-length": "134", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
76892024-12-06T02:53:00.769ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76902024-12-06T02:53:00.769ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
76912024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76922024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76932024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76942024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76952024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76962024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76972024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76982024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76992024-12-06T02:53:00.770ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
77002024-12-06T02:53:00.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77012024-12-06T02:53:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77022024-12-06T02:53:00.772ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77032024-12-06T02:53:00.772ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfbbcead-edcc-4c9c-bf6d-c5d2a7a2a0d4", "content-length": "2", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
77042024-12-06T02:53:00.772ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77052024-12-06T02:53:00.772ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a09b74ee-ab9f-4199-93f9-890bee502115", "content-length": "52", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
77062024-12-06T02:53:00.772ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
77072024-12-06T02:53:00.772ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77082024-12-06T02:53:00.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c979ea6d-e286-489d-82ad-02bdf1dfcd52", "content-length": "691", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
77092024-12-06T02:53:00.844ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
77102024-12-06T02:53:00.844ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
77112024-12-06T02:53:00.844ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
77122024-12-06T02:53:00.846ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 746.213414ms iteration = 23 status = {}
77132024-12-06T02:53:00.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cd7fc6b7-a343-4dc4-a992-8b64636cf6ac", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
77142024-12-06T02:53:00.929ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
77152024-12-06T02:53:00.929ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77162024-12-06T02:53:00.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "153912cc-6a0c-46b5-9c00-da7eeb06c68e", "content-length": "682", "date": "Fri, 06 Dec 2024 02:53:00 GMT"} })
77172024-12-06T02:53:00.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77182024-12-06T02:53:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77192024-12-06T02:53:00.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77202024-12-06T02:53:00.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77212024-12-06T02:53:00.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77222024-12-06T02:53:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77232024-12-06T02:53:00.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77242024-12-06T02:53:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77252024-12-06T02:53:00.946ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 846.269322ms iteration = 23 status = {}
77262024-12-06T02:53:01.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a73284c7-3332-4e19-950f-8a70925e676c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77272024-12-06T02:53:01.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a73284c7-3332-4e19-950f-8a70925e676c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77282024-12-06T02:53:01.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a73284c7-3332-4e19-950f-8a70925e676c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77292024-12-06T02:53:01.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ebf5210d-0ce2-4f6d-9332-a033256bc8a2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77302024-12-06T02:53:01.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ebf5210d-0ce2-4f6d-9332-a033256bc8a2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77312024-12-06T02:53:01.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ebf5210d-0ce2-4f6d-9332-a033256bc8a2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77322024-12-06T02:53:02.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7685ebf9-9dfb-46a1-9bfc-7d3cea0ac2dc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77332024-12-06T02:53:02.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7685ebf9-9dfb-46a1-9bfc-7d3cea0ac2dc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77342024-12-06T02:53:02.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7685ebf9-9dfb-46a1-9bfc-7d3cea0ac2dc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77352024-12-06T02:53:03.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 31d86acd-97a4-4bca-bac6-cc012401b0ae roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77362024-12-06T02:53:03.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 31d86acd-97a4-4bca-bac6-cc012401b0ae resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77372024-12-06T02:53:03.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 31d86acd-97a4-4bca-bac6-cc012401b0ae response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77382024-12-06T02:53:04.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 85d22ffd-69c8-49d2-a1d0-66d586e24aac roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77392024-12-06T02:53:04.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 85d22ffd-69c8-49d2-a1d0-66d586e24aac resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77402024-12-06T02:53:04.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 85d22ffd-69c8-49d2-a1d0-66d586e24aac response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77412024-12-06T02:53:05.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1384 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 9b706ba5-346d-4356-9585-a5e4fd578f6e response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
77422024-12-06T02:53:05.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c47459f2-ff15-462b-b155-d40ee4cf3323 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77432024-12-06T02:53:05.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c47459f2-ff15-462b-b155-d40ee4cf3323 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77442024-12-06T02:53:05.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c47459f2-ff15-462b-b155-d40ee4cf3323 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77452024-12-06T02:53:06.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a93bd904-26a5-46fc-ac03-78115ebb8fec roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77462024-12-06T02:53:06.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a93bd904-26a5-46fc-ac03-78115ebb8fec resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77472024-12-06T02:53:06.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a93bd904-26a5-46fc-ac03-78115ebb8fec response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77482024-12-06T02:53:07.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 474b4f61-23dd-41af-8a5e-66d25f62c974 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77492024-12-06T02:53:07.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 474b4f61-23dd-41af-8a5e-66d25f62c974 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77502024-12-06T02:53:07.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 474b4f61-23dd-41af-8a5e-66d25f62c974 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77512024-12-06T02:53:08.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6b7257a3-d88a-4d85-8807-b3beeab785d3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77522024-12-06T02:53:08.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6b7257a3-d88a-4d85-8807-b3beeab785d3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77532024-12-06T02:53:08.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6b7257a3-d88a-4d85-8807-b3beeab785d3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77542024-12-06T02:53:09.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6f65bea0-6e90-43a9-8912-43aee39528f5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77552024-12-06T02:53:09.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6f65bea0-6e90-43a9-8912-43aee39528f5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77562024-12-06T02:53:09.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6f65bea0-6e90-43a9-8912-43aee39528f5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77572024-12-06T02:53:10.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
77582024-12-06T02:53:10.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
77592024-12-06T02:53:10.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77602024-12-06T02:53:10.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77612024-12-06T02:53:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77622024-12-06T02:53:10.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77632024-12-06T02:53:10.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77642024-12-06T02:53:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77652024-12-06T02:53:10.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77662024-12-06T02:53:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77672024-12-06T02:53:10.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77682024-12-06T02:53:10.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77692024-12-06T02:53:10.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77702024-12-06T02:53:10.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
77712024-12-06T02:53:10.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77722024-12-06T02:53:10.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77732024-12-06T02:53:10.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
77742024-12-06T02:53:10.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.512902ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
77752024-12-06T02:53:10.135ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77762024-12-06T02:53:10.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77772024-12-06T02:53:10.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.890192ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77782024-12-06T02:53:10.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf00bb77-6899-46a9-93f4-10982e213f0a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77792024-12-06T02:53:10.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf00bb77-6899-46a9-93f4-10982e213f0a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77802024-12-06T02:53:10.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf00bb77-6899-46a9-93f4-10982e213f0a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77812024-12-06T02:53:11.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e7f3f47d-fd9b-4876-9861-c11b24ccf7a6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77822024-12-06T02:53:11.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e7f3f47d-fd9b-4876-9861-c11b24ccf7a6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77832024-12-06T02:53:11.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e7f3f47d-fd9b-4876-9861-c11b24ccf7a6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77842024-12-06T02:53:12.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b691aefa-b852-4bbe-bac1-e081f006e724 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77852024-12-06T02:53:12.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b691aefa-b852-4bbe-bac1-e081f006e724 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77862024-12-06T02:53:12.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b691aefa-b852-4bbe-bac1-e081f006e724 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77872024-12-06T02:53:13.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d34f562f-e9d2-487c-87f1-19b2554346f7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77882024-12-06T02:53:13.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d34f562f-e9d2-487c-87f1-19b2554346f7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77892024-12-06T02:53:13.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d34f562f-e9d2-487c-87f1-19b2554346f7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77902024-12-06T02:53:14.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 934816a2-b417-486d-9cd9-0e097bf13f67 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77912024-12-06T02:53:14.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 934816a2-b417-486d-9cd9-0e097bf13f67 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77922024-12-06T02:53:14.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 934816a2-b417-486d-9cd9-0e097bf13f67 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
77932024-12-06T02:53:15.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 541f58bb-1a5f-4141-87ee-79c5b702eba2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
77942024-12-06T02:53:15.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 541f58bb-1a5f-4141-87ee-79c5b702eba2 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
77952024-12-06T02:53:15.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 541f58bb-1a5f-4141-87ee-79c5b702eba2 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
77962024-12-06T02:53:15.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = ce58fa02-4105-4a70-ad17-b7a556b701cd roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
77972024-12-06T02:53:15.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = ce58fa02-4105-4a70-ad17-b7a556b701cd resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
77982024-12-06T02:53:15.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = ce58fa02-4105-4a70-ad17-b7a556b701cd response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
77992024-12-06T02:53:15.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1149 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 03e6dbee-05c8-40bc-a4e8-1506f99dc815 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
78002024-12-06T02:53:15.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fbf1be97-da38-4313-b163-8e880080cfc7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78012024-12-06T02:53:15.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fbf1be97-da38-4313-b163-8e880080cfc7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78022024-12-06T02:53:15.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fbf1be97-da38-4313-b163-8e880080cfc7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78032024-12-06T02:53:16.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5bf35c18-abd9-4a4d-a825-40f7994a0d64 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78042024-12-06T02:53:16.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5bf35c18-abd9-4a4d-a825-40f7994a0d64 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78052024-12-06T02:53:16.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5bf35c18-abd9-4a4d-a825-40f7994a0d64 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78062024-12-06T02:53:17.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a4016cf5-76b4-4053-85f2-fbe9553fc13d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78072024-12-06T02:53:17.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a4016cf5-76b4-4053-85f2-fbe9553fc13d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78082024-12-06T02:53:17.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a4016cf5-76b4-4053-85f2-fbe9553fc13d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78092024-12-06T02:53:19.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 549ef0c9-af20-43f9-9d7d-63cc704fc9e6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78102024-12-06T02:53:19.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 549ef0c9-af20-43f9-9d7d-63cc704fc9e6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78112024-12-06T02:53:19.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 549ef0c9-af20-43f9-9d7d-63cc704fc9e6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78122024-12-06T02:53:20.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 59760d51-fc3c-4163-9634-a85f3c52abef roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78132024-12-06T02:53:20.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 59760d51-fc3c-4163-9634-a85f3c52abef resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78142024-12-06T02:53:20.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 59760d51-fc3c-4163-9634-a85f3c52abef response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78152024-12-06T02:53:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
78162024-12-06T02:53:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78172024-12-06T02:53:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
78182024-12-06T02:53:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78192024-12-06T02:53:20.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78202024-12-06T02:53:20.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78212024-12-06T02:53:20.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78222024-12-06T02:53:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78232024-12-06T02:53:20.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78242024-12-06T02:53:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78252024-12-06T02:53:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78262024-12-06T02:53:20.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78272024-12-06T02:53:20.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78282024-12-06T02:53:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
78292024-12-06T02:53:20.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78302024-12-06T02:53:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78312024-12-06T02:53:20.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
78322024-12-06T02:53:20.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.125036ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
78332024-12-06T02:53:20.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78342024-12-06T02:53:20.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78352024-12-06T02:53:20.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.323523ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78362024-12-06T02:53:21.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28b1c03a-2f9b-4df5-a15d-e3758818ea8f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78372024-12-06T02:53:21.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28b1c03a-2f9b-4df5-a15d-e3758818ea8f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78382024-12-06T02:53:21.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 28b1c03a-2f9b-4df5-a15d-e3758818ea8f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78392024-12-06T02:53:22.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 660701f7-4357-4e1d-b73f-e18ca1793ab4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78402024-12-06T02:53:22.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 660701f7-4357-4e1d-b73f-e18ca1793ab4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78412024-12-06T02:53:22.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 660701f7-4357-4e1d-b73f-e18ca1793ab4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78422024-12-06T02:53:23.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 78dfb981-7966-4aad-8729-15457a27a142 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78432024-12-06T02:53:23.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 78dfb981-7966-4aad-8729-15457a27a142 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78442024-12-06T02:53:23.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 78dfb981-7966-4aad-8729-15457a27a142 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78452024-12-06T02:53:23.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 5b0b0f8f-38ae-492f-aa2b-ce75f18294d7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
78462024-12-06T02:53:23.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 5b0b0f8f-38ae-492f-aa2b-ce75f18294d7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
78472024-12-06T02:53:23.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 5b0b0f8f-38ae-492f-aa2b-ce75f18294d7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
78482024-12-06T02:53:23.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 5c5b46cf-51e9-422b-a757-478fd2ab85f7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
78492024-12-06T02:53:23.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 5c5b46cf-51e9-422b-a757-478fd2ab85f7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
78502024-12-06T02:53:23.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 5c5b46cf-51e9-422b-a757-478fd2ab85f7 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
78512024-12-06T02:53:24.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b3731b5-d047-43ff-bebf-8eeff6821f8f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78522024-12-06T02:53:24.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b3731b5-d047-43ff-bebf-8eeff6821f8f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78532024-12-06T02:53:24.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b3731b5-d047-43ff-bebf-8eeff6821f8f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78542024-12-06T02:53:25.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1245 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 9f675078-ed82-4adf-afb9-54dba2f258f0 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
78552024-12-06T02:53:25.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f5a7526d-8f31-4ef3-9327-27276fc0115c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78562024-12-06T02:53:25.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f5a7526d-8f31-4ef3-9327-27276fc0115c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78572024-12-06T02:53:25.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f5a7526d-8f31-4ef3-9327-27276fc0115c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78582024-12-06T02:53:26.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba70a81a-4281-4da5-bc2a-0fafa09ef066 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78592024-12-06T02:53:26.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba70a81a-4281-4da5-bc2a-0fafa09ef066 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78602024-12-06T02:53:26.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ba70a81a-4281-4da5-bc2a-0fafa09ef066 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78612024-12-06T02:53:27.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf7c3e87-adfd-40e5-adc9-d565e101002d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78622024-12-06T02:53:27.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf7c3e87-adfd-40e5-adc9-d565e101002d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78632024-12-06T02:53:27.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf7c3e87-adfd-40e5-adc9-d565e101002d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78642024-12-06T02:53:28.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d78ec5f-a000-481c-a426-c7f1a560f9fd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78652024-12-06T02:53:28.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d78ec5f-a000-481c-a426-c7f1a560f9fd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78662024-12-06T02:53:28.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d78ec5f-a000-481c-a426-c7f1a560f9fd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78672024-12-06T02:53:29.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1e36ec7f-0bde-4ae3-8870-fa4e524b3d72 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78682024-12-06T02:53:29.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1e36ec7f-0bde-4ae3-8870-fa4e524b3d72 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78692024-12-06T02:53:29.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1e36ec7f-0bde-4ae3-8870-fa4e524b3d72 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
78702024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
78712024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78722024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
78732024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78742024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
78752024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
78762024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78772024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78782024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
78792024-12-06T02:53:30.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78802024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78812024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
78822024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
78832024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78842024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78852024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
78862024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
78872024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78882024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
78892024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78902024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78912024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
78922024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78932024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
78942024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
78952024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78962024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78972024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
78982024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78992024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
79002024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79012024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
79022024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79032024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
79042024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79052024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79062024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79072024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79082024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79092024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79102024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79112024-12-06T02:53:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79122024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79132024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79142024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79152024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79162024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79172024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79182024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79192024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79202024-12-06T02:53:30.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79212024-12-06T02:53:30.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79222024-12-06T02:53:30.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79232024-12-06T02:53:30.108ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6358, tv_nsec: 476515311 } })
79242024-12-06T02:53:30.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
79252024-12-06T02:53:30.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79262024-12-06T02:53:30.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79272024-12-06T02:53:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79282024-12-06T02:53:30.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79292024-12-06T02:53:30.113ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.476306ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79302024-12-06T02:53:30.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79312024-12-06T02:53:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79322024-12-06T02:53:30.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79332024-12-06T02:53:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79342024-12-06T02:53:30.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6358, tv_nsec: 485494597 } })
79352024-12-06T02:53:30.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
79362024-12-06T02:53:30.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.868286ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79372024-12-06T02:53:30.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79382024-12-06T02:53:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79392024-12-06T02:53:30.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6358, tv_nsec: 491445866 } })
79402024-12-06T02:53:30.123ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
79412024-12-06T02:53:30.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422024-12-06T02:53:30.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79432024-12-06T02:53:30.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79442024-12-06T02:53:30.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79452024-12-06T02:53:30.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79462024-12-06T02:53:30.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79472024-12-06T02:53:30.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79482024-12-06T02:53:30.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79492024-12-06T02:53:30.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79502024-12-06T02:53:30.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.694151ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
79512024-12-06T02:53:30.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79522024-12-06T02:53:30.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79532024-12-06T02:53:30.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79542024-12-06T02:53:30.180ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79552024-12-06T02:53:30.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79562024-12-06T02:53:30.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.383787ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
79572024-12-06T02:53:30.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79582024-12-06T02:53:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79592024-12-06T02:53:30.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79602024-12-06T02:53:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79612024-12-06T02:53:30.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79622024-12-06T02:53:30.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79632024-12-06T02:53:30.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79642024-12-06T02:53:30.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79652024-12-06T02:53:30.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79662024-12-06T02:53:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79672024-12-06T02:53:30.183ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79682024-12-06T02:53:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79692024-12-06T02:53:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79702024-12-06T02:53:30.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79712024-12-06T02:53:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79722024-12-06T02:53:30.186ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79732024-12-06T02:53:30.186ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79742024-12-06T02:53:30.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79752024-12-06T02:53:30.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
79762024-12-06T02:53:30.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79772024-12-06T02:53:30.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79782024-12-06T02:53:30.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79792024-12-06T02:53:30.186ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79802024-12-06T02:53:30.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79812024-12-06T02:53:30.187ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc0f7f74-a252-48ca-a9be-ac56bb6d020c", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
79822024-12-06T02:53:30.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79832024-12-06T02:53:30.187ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79842024-12-06T02:53:30.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79852024-12-06T02:53:30.189ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79862024-12-06T02:53:30.197ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
79872024-12-06T02:53:30.197ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.722272ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
79882024-12-06T02:53:30.208ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79892024-12-06T02:53:30.208ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79902024-12-06T02:53:30.208ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a37e2743-e856-4452-bf32-083ee213fece", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
79912024-12-06T02:53:30.208ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79922024-12-06T02:53:30.210ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79932024-12-06T02:53:30.211ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
79942024-12-06T02:53:30.211ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79952024-12-06T02:53:30.211ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "707361be-1703-40fb-8a83-de5ad2fd2231", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
79962024-12-06T02:53:30.211ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79972024-12-06T02:53:30.214ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
79982024-12-06T02:53:30.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79992024-12-06T02:53:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80002024-12-06T02:53:30.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80012024-12-06T02:53:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80022024-12-06T02:53:30.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80032024-12-06T02:53:30.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 135.146829ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80042024-12-06T02:53:30.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80052024-12-06T02:53:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80062024-12-06T02:53:30.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80072024-12-06T02:53:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80082024-12-06T02:53:30.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 139.031241ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80092024-12-06T02:53:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
80102024-12-06T02:53:30.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80112024-12-06T02:53:30.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80122024-12-06T02:53:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80132024-12-06T02:53:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80142024-12-06T02:53:30.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80152024-12-06T02:53:30.243ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 142.236122ms iteration = 24 status = 0
80162024-12-06T02:53:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80172024-12-06T02:53:30.245ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80182024-12-06T02:53:30.245ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80192024-12-06T02:53:30.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80202024-12-06T02:53:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80212024-12-06T02:53:30.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e3481a3a-12ff-4f55-812c-cb899ea47923 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
80222024-12-06T02:53:30.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e3481a3a-12ff-4f55-812c-cb899ea47923 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
80232024-12-06T02:53:30.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e3481a3a-12ff-4f55-812c-cb899ea47923 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
80242024-12-06T02:53:30.286ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80252024-12-06T02:53:30.286ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80262024-12-06T02:53:30.286ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.530959ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80272024-12-06T02:53:30.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.150182ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80282024-12-06T02:53:30.290ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80292024-12-06T02:53:30.291ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "199f831f-22a4-4202-8e5c-1a1c17437e4e", "content-length": "1", "date": "Fri, 06 Dec 2024 02:53:29 GMT"} })
80302024-12-06T02:53:30.293ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80312024-12-06T02:53:30.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80322024-12-06T02:53:30.295ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.69835ms iteration = 24 status = null
80332024-12-06T02:53:30.316ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.042331ms iteration = 24 status = {}
80342024-12-06T02:53:30.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state
80352024-12-06T02:53:30.359ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80362024-12-06T02:53:30.359ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80372024-12-06T02:53:30.360ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 259.064859ms iteration = 28 status = {"physical_disks_added":0}
80382024-12-06T02:53:30.360ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "03859eaf-6caf-4be3-a0cb-47787aca476a", "content-length": "525", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
80392024-12-06T02:53:30.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80402024-12-06T02:53:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80412024-12-06T02:53:30.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80422024-12-06T02:53:30.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80432024-12-06T02:53:30.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80442024-12-06T02:53:30.376ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80452024-12-06T02:53:30.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80462024-12-06T02:53:30.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80472024-12-06T02:53:30.378ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80482024-12-06T02:53:30.379ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80492024-12-06T02:53:30.379ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80502024-12-06T02:53:30.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80512024-12-06T02:53:30.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80522024-12-06T02:53:30.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80532024-12-06T02:53:30.380ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "41c4735f-06fa-4fdb-aac8-bd4f9c845e86", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
80542024-12-06T02:53:30.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80552024-12-06T02:53:30.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80562024-12-06T02:53:30.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80572024-12-06T02:53:30.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80582024-12-06T02:53:30.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80592024-12-06T02:53:30.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80602024-12-06T02:53:30.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80612024-12-06T02:53:30.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80622024-12-06T02:53:30.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80632024-12-06T02:53:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80642024-12-06T02:53:30.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80652024-12-06T02:53:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80662024-12-06T02:53:30.399ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80672024-12-06T02:53:30.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80682024-12-06T02:53:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80692024-12-06T02:53:30.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80702024-12-06T02:53:30.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80712024-12-06T02:53:30.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80722024-12-06T02:53:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80732024-12-06T02:53:30.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80742024-12-06T02:53:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80752024-12-06T02:53:30.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80762024-12-06T02:53:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80772024-12-06T02:53:30.407ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
80782024-12-06T02:53:30.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80792024-12-06T02:53:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80802024-12-06T02:53:30.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80812024-12-06T02:53:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80822024-12-06T02:53:30.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80832024-12-06T02:53:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80842024-12-06T02:53:30.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80852024-12-06T02:53:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80862024-12-06T02:53:30.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80872024-12-06T02:53:30.416ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80882024-12-06T02:53:30.416ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "51b51f4b-601b-404d-94c5-33ec94cc8f2a", "content-length": "134", "date": "Fri, 06 Dec 2024 02:53:29 GMT"} })
80892024-12-06T02:53:30.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ab092697-6169-40b9-a26e-0e11cf44d6ce, lookup_type: ById(ab092697-6169-40b9-a26e-0e11cf44d6ce) }, key: fa7950f0-1322-4677-b575-7da6066834f3, lookup_type: ById(fa7950f0-1322-4677-b575-7da6066834f3) } result = Ok(())
80902024-12-06T02:53:30.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80912024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80922024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
80932024-12-06T02:53:30.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80942024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80952024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80962024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80972024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80982024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80992024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81002024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81012024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81022024-12-06T02:53:30.417ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
81032024-12-06T02:53:30.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81042024-12-06T02:53:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81052024-12-06T02:53:30.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81062024-12-06T02:53:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81072024-12-06T02:53:30.419ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81082024-12-06T02:53:30.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "72d18125-c740-4443-9433-968977b4c6b1", "content-length": "2", "date": "Fri, 06 Dec 2024 02:53:29 GMT"} })
81092024-12-06T02:53:30.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81102024-12-06T02:53:30.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81112024-12-06T02:53:30.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "37d06b1d-9630-4072-bae4-f416a87be55d", "content-length": "52", "date": "Fri, 06 Dec 2024 02:53:29 GMT"} })
81122024-12-06T02:53:30.420ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
81132024-12-06T02:53:30.420ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81142024-12-06T02:53:30.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81152024-12-06T02:53:30.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81162024-12-06T02:53:30.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ab092697-6169-40b9-a26e-0e11cf44d6ce, lookup_type: ById(ab092697-6169-40b9-a26e-0e11cf44d6ce) }, key: fa7950f0-1322-4677-b575-7da6066834f3, lookup_type: ById(fa7950f0-1322-4677-b575-7da6066834f3) } result = Ok(())
81172024-12-06T02:53:30.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81182024-12-06T02:53:30.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81192024-12-06T02:53:30.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81202024-12-06T02:53:30.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81212024-12-06T02:53:30.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81222024-12-06T02:53:30.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81232024-12-06T02:53:30.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81242024-12-06T02:53:30.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81252024-12-06T02:53:30.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81262024-12-06T02:53:30.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81272024-12-06T02:53:30.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81282024-12-06T02:53:30.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81292024-12-06T02:53:30.467ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81302024-12-06T02:53:30.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81312024-12-06T02:53:30.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81322024-12-06T02:53:30.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81332024-12-06T02:53:30.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81342024-12-06T02:53:30.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81352024-12-06T02:53:30.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ab092697-6169-40b9-a26e-0e11cf44d6ce, lookup_type: ById(ab092697-6169-40b9-a26e-0e11cf44d6ce) }, key: cbd79ad4-13e4-4ffa-9a98-0fab8950f4e9, lookup_type: ByName("default") } result = Ok(())
81362024-12-06T02:53:30.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81372024-12-06T02:53:30.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81382024-12-06T02:53:30.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81392024-12-06T02:53:30.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81402024-12-06T02:53:30.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81412024-12-06T02:53:30.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81422024-12-06T02:53:30.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81432024-12-06T02:53:30.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81442024-12-06T02:53:30.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81452024-12-06T02:53:30.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81462024-12-06T02:53:30.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81472024-12-06T02:53:30.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81482024-12-06T02:53:30.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81492024-12-06T02:53:30.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81502024-12-06T02:53:30.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81512024-12-06T02:53:30.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ab092697-6169-40b9-a26e-0e11cf44d6ce, lookup_type: ById(ab092697-6169-40b9-a26e-0e11cf44d6ce) }, key: 4a73a4f7-b655-42c4-be72-08366a465943, lookup_type: ByName("default") } result = Ok(())
81522024-12-06T02:53:30.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81532024-12-06T02:53:30.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "832c874f-2534-4398-84d9-03bac44b86f5", "content-length": "811", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
81542024-12-06T02:53:30.507ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(10646420) }} sled = buskin
81552024-12-06T02:53:30.507ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81562024-12-06T02:53:30.507ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81572024-12-06T02:53:30.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "92093ff0-55eb-4430-9ebe-e09132714eb8", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
81582024-12-06T02:53:30.508ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 407.662974ms iteration = 25 status = {}
81592024-12-06T02:53:30.509ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 408.379623ms iteration = 24 status = {}
81602024-12-06T02:53:30.711ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7ffc07a8-3534-4497-ba36-9fc45f7779a2", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
81612024-12-06T02:53:30.711ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
81622024-12-06T02:53:30.711ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81632024-12-06T02:53:30.711ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbfdf8e0-6482-479c-9047-dd0ca547120f", "content-length": "682", "date": "Fri, 06 Dec 2024 02:53:30 GMT"} })
81642024-12-06T02:53:30.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81652024-12-06T02:53:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81662024-12-06T02:53:30.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81672024-12-06T02:53:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81682024-12-06T02:53:30.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81692024-12-06T02:53:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81702024-12-06T02:53:30.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81712024-12-06T02:53:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81722024-12-06T02:53:30.728ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.555124ms iteration = 24 status = {}
81732024-12-06T02:53:31.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 73bc31cd-f1fe-4d0b-8509-e5c722705cd3 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
81742024-12-06T02:53:31.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 73bc31cd-f1fe-4d0b-8509-e5c722705cd3 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
81752024-12-06T02:53:31.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 73bc31cd-f1fe-4d0b-8509-e5c722705cd3 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
81762024-12-06T02:53:31.510ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ea9c108-5147-4c9b-8894-fefe46226217", "content-length": "131", "date": "Fri, 06 Dec 2024 02:53:31 GMT"} })
81772024-12-06T02:53:31.510ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T02:53:23.904307115Z }, migration_in: None, migration_out: None } vmm_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81782024-12-06T02:53:31.510ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe vmm_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T02:53:23.904307115Z }
81792024-12-06T02:53:31.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a roles = RoleSet { roles: {} } sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe vmm_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81802024-12-06T02:53:31.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a resource = Database result = Ok(()) sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe vmm_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81812024-12-06T02:53:31.518ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1943ec1b-32e4-4a94-80eb-27aa5405a6d8 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T02:53:31.513767497Z }
81822024-12-06T02:53:31.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1943ec1b-32e4-4a94-80eb-27aa5405a6d8 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81832024-12-06T02:53:31.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1943ec1b-32e4-4a94-80eb-27aa5405a6d8 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81842024-12-06T02:53:31.546ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:64095
81852024-12-06T02:53:31.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64095 req_id = ea05f01f-acd4-4328-8368-3c2402c6749a roles = RoleSet { roles: {} } uri = /metrics/producers
81862024-12-06T02:53:31.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64095 req_id = ea05f01f-acd4-4328-8368-3c2402c6749a resource = Database result = Ok(()) uri = /metrics/producers
81872024-12-06T02:53:31.552ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
81882024-12-06T02:53:31.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.45327509s iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
81892024-12-06T02:53:31.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42085 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1943ec1b-32e4-4a94-80eb-27aa5405a6d8 response_code = 204 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81902024-12-06T02:53:31.556ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e52b4b1a-adcf-4314-af5f-5acf2ffc3207 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T02:53:31.556353063Z }
81912024-12-06T02:53:31.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e52b4b1a-adcf-4314-af5f-5acf2ffc3207 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81922024-12-06T02:53:31.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e52b4b1a-adcf-4314-af5f-5acf2ffc3207 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81932024-12-06T02:53:31.583ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = ac2b3a9b-d712-4e39-8833-8cb85445305a
81942024-12-06T02:53:31.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36079 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64095 req_id = ea05f01f-acd4-4328-8368-3c2402c6749a response_code = 201 uri = /metrics/producers
81952024-12-06T02:53:31.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35019 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e52b4b1a-adcf-4314-af5f-5acf2ffc3207 response_code = 204 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
81962024-12-06T02:53:32.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 877eb8da-0ce3-461c-8694-00926bac665a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
81972024-12-06T02:53:32.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 877eb8da-0ce3-461c-8694-00926bac665a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
81982024-12-06T02:53:32.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 877eb8da-0ce3-461c-8694-00926bac665a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
81992024-12-06T02:53:33.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0b41f6f2-3f57-4372-b8b5-3e346ecbbadd roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82002024-12-06T02:53:33.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0b41f6f2-3f57-4372-b8b5-3e346ecbbadd resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82012024-12-06T02:53:33.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0b41f6f2-3f57-4372-b8b5-3e346ecbbadd response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82022024-12-06T02:53:34.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b626653c-5fb7-4d52-b3a0-00a54c40ad93 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82032024-12-06T02:53:34.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b626653c-5fb7-4d52-b3a0-00a54c40ad93 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82042024-12-06T02:53:34.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b626653c-5fb7-4d52-b3a0-00a54c40ad93 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82052024-12-06T02:53:35.028ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3839 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = e48f8a6c-42b3-4ad5-a22b-ee621215c1cf response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
82062024-12-06T02:53:35.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebe00bbf-7386-41be-a13b-d6e4e6b2d22d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82072024-12-06T02:53:35.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebe00bbf-7386-41be-a13b-d6e4e6b2d22d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82082024-12-06T02:53:35.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ebe00bbf-7386-41be-a13b-d6e4e6b2d22d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82092024-12-06T02:53:36.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a87f013-9997-4d3c-8fe1-93a2e1b640dc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82102024-12-06T02:53:36.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a87f013-9997-4d3c-8fe1-93a2e1b640dc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82112024-12-06T02:53:36.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1a87f013-9997-4d3c-8fe1-93a2e1b640dc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82122024-12-06T02:53:37.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 706ec081-3bd6-4e19-95a9-124f39cd4187 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82132024-12-06T02:53:37.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 706ec081-3bd6-4e19-95a9-124f39cd4187 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82142024-12-06T02:53:37.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 706ec081-3bd6-4e19-95a9-124f39cd4187 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82152024-12-06T02:53:38.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 27accbc7-4df0-4637-b73d-21acd1b6ca02 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82162024-12-06T02:53:38.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 27accbc7-4df0-4637-b73d-21acd1b6ca02 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82172024-12-06T02:53:38.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 27accbc7-4df0-4637-b73d-21acd1b6ca02 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82182024-12-06T02:53:39.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dac5a5c4-a8cc-4bac-a6b1-92c507ae945d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82192024-12-06T02:53:39.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dac5a5c4-a8cc-4bac-a6b1-92c507ae945d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82202024-12-06T02:53:39.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dac5a5c4-a8cc-4bac-a6b1-92c507ae945d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82212024-12-06T02:53:40.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
82222024-12-06T02:53:40.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
82232024-12-06T02:53:40.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82242024-12-06T02:53:40.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82252024-12-06T02:53:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82262024-12-06T02:53:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82272024-12-06T02:53:40.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282024-12-06T02:53:40.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82292024-12-06T02:53:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82302024-12-06T02:53:40.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.769557ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82312024-12-06T02:53:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82322024-12-06T02:53:40.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82332024-12-06T02:53:40.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82342024-12-06T02:53:40.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82352024-12-06T02:53:40.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82362024-12-06T02:53:40.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82372024-12-06T02:53:40.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
82382024-12-06T02:53:40.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82392024-12-06T02:53:40.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82402024-12-06T02:53:40.119ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
82412024-12-06T02:53:40.119ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.946271ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
82422024-12-06T02:53:40.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 230bd023-e504-4127-a06f-e408fbb84858 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82432024-12-06T02:53:40.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 230bd023-e504-4127-a06f-e408fbb84858 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82442024-12-06T02:53:40.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 230bd023-e504-4127-a06f-e408fbb84858 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82452024-12-06T02:53:41.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 19741ea9-2efc-4d2e-a700-bd5fb055833e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82462024-12-06T02:53:41.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 19741ea9-2efc-4d2e-a700-bd5fb055833e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82472024-12-06T02:53:41.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 19741ea9-2efc-4d2e-a700-bd5fb055833e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82482024-12-06T02:53:41.604ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9cca757f-0915-45c2-a93f-0f101af040fb uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T02:53:41.604607436Z }
82492024-12-06T02:53:41.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9cca757f-0915-45c2-a93f-0f101af040fb roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82502024-12-06T02:53:41.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9cca757f-0915-45c2-a93f-0f101af040fb resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82512024-12-06T02:53:41.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11548 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9cca757f-0915-45c2-a93f-0f101af040fb response_code = 204 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82522024-12-06T02:53:41.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ca843248-0de6-47f4-ad82-ba0d3ffeb585 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
82532024-12-06T02:53:41.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ca843248-0de6-47f4-ad82-ba0d3ffeb585 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
82542024-12-06T02:53:41.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ca843248-0de6-47f4-ad82-ba0d3ffeb585 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
82552024-12-06T02:53:41.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 026a100d-891d-4122-a494-953a7ebf53a8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82562024-12-06T02:53:41.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 026a100d-891d-4122-a494-953a7ebf53a8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82572024-12-06T02:53:41.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 026a100d-891d-4122-a494-953a7ebf53a8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82582024-12-06T02:53:42.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf06299d-b94c-4540-921d-4cbaab9f46c7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82592024-12-06T02:53:42.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf06299d-b94c-4540-921d-4cbaab9f46c7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82602024-12-06T02:53:42.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cf06299d-b94c-4540-921d-4cbaab9f46c7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82612024-12-06T02:53:43.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a841e67f-4ff2-4ec7-be10-de2de381fbaf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82622024-12-06T02:53:43.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a841e67f-4ff2-4ec7-be10-de2de381fbaf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82632024-12-06T02:53:43.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a841e67f-4ff2-4ec7-be10-de2de381fbaf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
82642024-12-06T02:53:43.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 344226cd-eb51-4de0-b846-af2534cb3b00 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82652024-12-06T02:53:43.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 344226cd-eb51-4de0-b846-af2534cb3b00 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82662024-12-06T02:53:43.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 344226cd-eb51-4de0-b846-af2534cb3b00 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82672024-12-06T02:53:44.038ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T02:53:44.038622200Z }
82682024-12-06T02:53:44.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82692024-12-06T02:53:44.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82702024-12-06T02:53:44.051ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_needs_update = true
82712024-12-06T02:53:44.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82722024-12-06T02:53:44.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82732024-12-06T02:53:44.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82742024-12-06T02:53:44.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82752024-12-06T02:53:44.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82762024-12-06T02:53:44.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82772024-12-06T02:53:44.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82782024-12-06T02:53:44.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82792024-12-06T02:53:44.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82802024-12-06T02:53:44.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82812024-12-06T02:53:44.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82822024-12-06T02:53:44.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82832024-12-06T02:53:44.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82842024-12-06T02:53:44.064ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ac2b3a9b-d712-4e39-8833-8cb85445305a, lookup_type: ById(ac2b3a9b-d712-4e39-8833-8cb85445305a) } result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82852024-12-06T02:53:44.064ZINFOnexus (dropshot_internal): starting update saga for ac2b3a9b-d712-4e39-8833-8cb85445305a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T02:53:44.038622200Z }
82862024-12-06T02:53:44.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25672 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 response_code = 204 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82872024-12-06T02:53:44.064ZDEBGnexus (dropshot_internal): preparing instance-update saga for ac2b3a9b-d712-4e39-8833-8cb85445305a... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b98c0a00-8d03-4ad0-986c-0add1b67d230 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82882024-12-06T02:53:44.064ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update
82892024-12-06T02:53:44.064ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"ac2b3a9b-d712-4e39-8833-8cb85445305a","lookup_type":{"ById":"ac2b3a9b-d712-4e39-8833-8cb85445305a"},"parent":{"key":"e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc","lookup_type":{"ById":"e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc"},"parent":{"key":"36adb3b8-4238-4eb5-8913-0041468585a1","lookup_type":{"ById":"36adb3b8-4238-4eb5-8913-0041468585a1"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
82902024-12-06T02:53:44.064ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update
82912024-12-06T02:53:44.065ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72e7bf33-2f5f-4791-ad83-3a202d549300 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T02:53:44.038622200Z }
82922024-12-06T02:53:44.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72e7bf33-2f5f-4791-ad83-3a202d549300 roles = RoleSet { roles: {} } uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82932024-12-06T02:53:44.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72e7bf33-2f5f-4791-ad83-3a202d549300 resource = Database result = Ok(()) uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82942024-12-06T02:53:44.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11766 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72e7bf33-2f5f-4791-ad83-3a202d549300 response_code = 204 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
82952024-12-06T02:53:44.096ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update
82962024-12-06T02:53:44.096ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
82972024-12-06T02:53:44.096ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
82982024-12-06T02:53:44.096ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
82992024-12-06T02:53:44.101ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83002024-12-06T02:53:44.101ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
83012024-12-06T02:53:44.106ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83022024-12-06T02:53:44.106ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
83032024-12-06T02:53:44.110ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83042024-12-06T02:53:44.110ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ca355813-d8ec-4f62-9448-8e1f752803fc")) node_id = 0 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
83052024-12-06T02:53:44.115ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83062024-12-06T02:53:44.115ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
83072024-12-06T02:53:44.121ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update
83082024-12-06T02:53:44.121ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83092024-12-06T02:53:44.121ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83102024-12-06T02:53:44.123ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83112024-12-06T02:53:44.124ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83122024-12-06T02:53:44.125ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83132024-12-06T02:53:44.125ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83142024-12-06T02:53:44.127ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83152024-12-06T02:53:44.127ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83162024-12-06T02:53:44.128ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83172024-12-06T02:53:44.128ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83182024-12-06T02:53:44.129ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83192024-12-06T02:53:44.130ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83202024-12-06T02:53:44.131ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83212024-12-06T02:53:44.134ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ac2b3a9b-d712-4e39-8833-8cb85445305a, lookup_type: ById(ac2b3a9b-d712-4e39-8833-8cb85445305a) } result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83222024-12-06T02:53:44.134ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance updater_id = ca355813-d8ec-4f62-9448-8e1f752803fc
83232024-12-06T02:53:44.134ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83242024-12-06T02:53:44.134ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83252024-12-06T02:53:44.151ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance updater_id = ca355813-d8ec-4f62-9448-8e1f752803fc
83262024-12-06T02:53:44.151ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83272024-12-06T02:53:44.152ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance
83282024-12-06T02:53:44.156ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a locked_gen = Generation(Generation(2)) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = LockInstance updater_id = ca355813-d8ec-4f62-9448-8e1f752803fc
83292024-12-06T02:53:44.161ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83302024-12-06T02:53:44.161ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ca355813-d8ec-4f62-9448-8e1f752803fc")}) node_id = 1 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
83312024-12-06T02:53:44.165ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83322024-12-06T02:53:44.165ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
83332024-12-06T02:53:44.171ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83342024-12-06T02:53:44.171ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83352024-12-06T02:53:44.173ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83362024-12-06T02:53:44.173ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83372024-12-06T02:53:44.174ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83382024-12-06T02:53:44.174ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83392024-12-06T02:53:44.175ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83402024-12-06T02:53:44.178ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ac2b3a9b-d712-4e39-8833-8cb85445305a, lookup_type: ById(ac2b3a9b-d712-4e39-8833-8cb85445305a) } result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83412024-12-06T02:53:44.178ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83422024-12-06T02:53:44.178ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83432024-12-06T02:53:44.189ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 3c341a9c-82c0-49f4-9e74-b3a3ba58635c, time_created: 2024-12-06T02:53:23.326554Z, time_deleted: None, instance_id: ac2b3a9b-d712-4e39-8833-8cb85445305a, sled_id: 5455a27f-b1dd-4d8d-adde-726221dabebe, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-06T02:53:44.038622Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-06T02:53:21.121922Z, gen: Generation(Generation(3)), propolis_id: Some(3c341a9c-82c0-49f4-9e74-b3a3ba58635c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(3c341a9c-82c0-49f4-9e74-b3a3ba58635c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-06T02:53:44.189330213Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
83442024-12-06T02:53:44.191ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
83452024-12-06T02:53:44.191ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"ac2b3a9b-d712-4e39-8833-8cb85445305a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"3c341a9c-82c0-49f4-9e74-b3a3ba58635c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"ac2b3a9b-d712-4e39-8833-8cb85445305a","lookup_type":{"ById":"ac2b3a9b-d712-4e39-8833-8cb85445305a"},"parent":{"key":"e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc","lookup_type":{"ById":"e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc"},"parent":{"key":"36adb3b8-4238-4eb5-8913-0041468585a1","lookup_type":{"ById":"36adb3b8-4238-4eb5-8913-0041468585a1"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"ca355813-d8ec-4f62-9448-8e1f752803fc"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc","ram_diff":1073741824},"destroy_active_vmm":"3c341a9c-82c0-49f4-9e74-b3a3ba58635c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-06T02:53:44.189330213Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83462024-12-06T02:53:44.191ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
83472024-12-06T02:53:44.222ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
83482024-12-06T02:53:44.222ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83492024-12-06T02:53:44.222ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83502024-12-06T02:53:44.222ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83512024-12-06T02:53:44.226ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83522024-12-06T02:53:44.226ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83532024-12-06T02:53:44.230ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83542024-12-06T02:53:44.230ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83552024-12-06T02:53:44.233ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83562024-12-06T02:53:44.233ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a49492b7-8fe6-4dc4-ba20-9dad65813b63")) node_id = 0 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83572024-12-06T02:53:44.236ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83582024-12-06T02:53:44.236ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83592024-12-06T02:53:44.241ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a parent_lock = UpdaterLock { updater_id: ca355813-d8ec-4f62-9448-8e1f752803fc, locked_gen: Generation(Generation(2)) } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
83602024-12-06T02:53:44.241ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = BecomeUpdater
83612024-12-06T02:53:44.241ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = BecomeUpdater
83622024-12-06T02:53:44.258ZDEBGnexus (SagaExecutor): inherited lock from ca355813-d8ec-4f62-9448-8e1f752803fc to a49492b7-8fe6-4dc4-ba20-9dad65813b63 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = ca355813-d8ec-4f62-9448-8e1f752803fc saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = BecomeUpdater updater_id = a49492b7-8fe6-4dc4-ba20-9dad65813b63
83632024-12-06T02:53:44.258ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
83642024-12-06T02:53:44.258ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83652024-12-06T02:53:44.258ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a49492b7-8fe6-4dc4-ba20-9dad65813b63")}) node_id = 1 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83662024-12-06T02:53:44.265ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83672024-12-06T02:53:44.265ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83682024-12-06T02:53:44.270ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83692024-12-06T02:53:44.270ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83702024-12-06T02:53:44.274ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83712024-12-06T02:53:44.274ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
83722024-12-06T02:53:44.279ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
83732024-12-06T02:53:44.281ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a
83742024-12-06T02:53:44.284ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UpdateNetworkConfig
83752024-12-06T02:53:44.284ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UpdateNetworkConfig
83762024-12-06T02:53:44.287ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UpdateNetworkConfig
83772024-12-06T02:53:44.287ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UpdateNetworkConfig
83782024-12-06T02:53:44.289ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
83792024-12-06T02:53:44.289ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UpdateNetworkConfig
83802024-12-06T02:53:44.289ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UpdateNetworkConfig
83812024-12-06T02:53:44.292ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
83822024-12-06T02:53:44.292ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
83832024-12-06T02:53:44.292ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
83842024-12-06T02:53:44.293ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
83852024-12-06T02:53:44.295ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
83862024-12-06T02:53:44.295ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
83872024-12-06T02:53:44.295ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
83882024-12-06T02:53:44.303ZDEBGnexus: notifying dendrite of updates instance_id = Some(ac2b3a9b-d712-4e39-8833-8cb85445305a (instance)) switch = switch0
83892024-12-06T02:53:44.303ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6372, tv_nsec: 671846137 } })
83902024-12-06T02:53:44.304ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
83912024-12-06T02:53:44.337ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83922024-12-06T02:53:44.337ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83932024-12-06T02:53:44.337ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99b9534c-af17-46bb-ac26-35bca4e361d4", "content-length": "26", "date": "Fri, 06 Dec 2024 02:53:44 GMT"} })
83942024-12-06T02:53:44.337ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83952024-12-06T02:53:44.338ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83962024-12-06T02:53:44.367ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
83972024-12-06T02:53:44.368ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "54f868cf-7810-4b09-8ef4-65d696e33ddd", "content-length": "4", "date": "Fri, 06 Dec 2024 02:53:43 GMT"} })
83982024-12-06T02:53:44.368ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
83992024-12-06T02:53:44.368ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84002024-12-06T02:53:44.372ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84012024-12-06T02:53:44.372ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84022024-12-06T02:53:44.377ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ReleaseVirtualProvisioning
84032024-12-06T02:53:44.377ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ReleaseVirtualProvisioning
84042024-12-06T02:53:44.395ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-06T02:53:44.382449Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 36adb3b8-4238-4eb5-8913-0041468585a1, time_modified: Some(2024-12-06T02:53:44.382449Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, time_modified: Some(2024-12-06T02:53:44.382449Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84052024-12-06T02:53:44.395ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84062024-12-06T02:53:44.395ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84072024-12-06T02:53:44.399ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84082024-12-06T02:53:44.399ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84092024-12-06T02:53:44.409ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84102024-12-06T02:53:44.409ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UnassignOximeterProducer
84112024-12-06T02:53:44.409ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UnassignOximeterProducer
84122024-12-06T02:53:44.420ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad producer_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84132024-12-06T02:53:44.420ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UnassignOximeterProducer
84142024-12-06T02:53:44.421ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = UnassignOximeterProducer
84152024-12-06T02:53:44.457ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84162024-12-06T02:53:44.460ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/ac2b3a9b-d712-4e39-8833-8cb85445305a
84172024-12-06T02:53:44.473ZDEBGnexus (SagaExecutor): client response oximeter-collector = ac2b3a9b-d712-4e39-8833-8cb85445305a result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/ac2b3a9b-d712-4e39-8833-8cb85445305a", status: 204, headers: {"x-request-id": "0fa88e98-f417-4c17-bb36-35b02e5479e6", "date": "Fri, 06 Dec 2024 02:53:44 GMT"} }) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84182024-12-06T02:53:44.473ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad producer_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84192024-12-06T02:53:44.474ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84202024-12-06T02:53:44.474ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84212024-12-06T02:53:44.479ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84222024-12-06T02:53:44.479ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84232024-12-06T02:53:44.482ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a lock = UpdaterLock { updater_id: a49492b7-8fe6-4dc4-ba20-9dad65813b63, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-06T02:53:44.189330213Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84242024-12-06T02:53:44.485ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = CommitInstanceUpdates
84252024-12-06T02:53:44.485ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = CommitInstanceUpdates
84262024-12-06T02:53:44.522ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a new_runtime = InstanceRuntimeState { time_updated: 2024-12-06T02:53:44.189330213Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84272024-12-06T02:53:44.522ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84282024-12-06T02:53:44.522ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84292024-12-06T02:53:44.522ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
84302024-12-06T02:53:44.522ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84312024-12-06T02:53:44.522ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
84322024-12-06T02:53:44.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84332024-12-06T02:53:44.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84342024-12-06T02:53:44.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84352024-12-06T02:53:44.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84362024-12-06T02:53:44.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84372024-12-06T02:53:44.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84382024-12-06T02:53:44.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84392024-12-06T02:53:44.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84402024-12-06T02:53:44.527ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84412024-12-06T02:53:44.527ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84422024-12-06T02:53:44.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84432024-12-06T02:53:44.529ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84442024-12-06T02:53:44.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84452024-12-06T02:53:44.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84462024-12-06T02:53:44.531ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84472024-12-06T02:53:44.531ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("ac2b3a9b-d712-4e39-8833-8cb85445305a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3c341a9c-82c0-49f4-9e74-b3a3ba58635c")}) node_id = 7 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84482024-12-06T02:53:44.536ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84492024-12-06T02:53:44.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84502024-12-06T02:53:44.547ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84512024-12-06T02:53:44.547ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84522024-12-06T02:53:44.551ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84532024-12-06T02:53:44.551ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84542024-12-06T02:53:44.555ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84552024-12-06T02:53:44.555ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ReleaseSledResources
84562024-12-06T02:53:44.556ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ReleaseSledResources
84572024-12-06T02:53:44.565ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84582024-12-06T02:53:44.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84592024-12-06T02:53:44.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84602024-12-06T02:53:44.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8455fba-d556-46d0-89b5-3c4d128d4314", "content-length": "372", "date": "Fri, 06 Dec 2024 02:53:44 GMT"} })
84612024-12-06T02:53:44.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84622024-12-06T02:53:44.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84632024-12-06T02:53:44.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84642024-12-06T02:53:44.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae7d8382-1299-48b6-b694-d1b67058c326 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
84652024-12-06T02:53:44.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae7d8382-1299-48b6-b694-d1b67058c326 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
84662024-12-06T02:53:44.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae7d8382-1299-48b6-b694-d1b67058c326 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
84672024-12-06T02:53:44.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84682024-12-06T02:53:44.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84692024-12-06T02:53:44.578ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84702024-12-06T02:53:44.578ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84712024-12-06T02:53:44.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84722024-12-06T02:53:44.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84732024-12-06T02:53:44.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84742024-12-06T02:53:44.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84752024-12-06T02:53:44.581ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84762024-12-06T02:53:44.581ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84772024-12-06T02:53:44.582ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84782024-12-06T02:53:44.582ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84792024-12-06T02:53:44.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84802024-12-06T02:53:44.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84812024-12-06T02:53:44.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84822024-12-06T02:53:44.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84832024-12-06T02:53:44.584ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "50838668-fb71-499f-b5c7-b95bb769739b", "date": "Fri, 06 Dec 2024 02:53:44 GMT"} })
84842024-12-06T02:53:44.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84852024-12-06T02:53:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84862024-12-06T02:53:44.585ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
84872024-12-06T02:53:44.585ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = MarkVmmDeleted
84882024-12-06T02:53:44.585ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = MarkVmmDeleted
84892024-12-06T02:53:44.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84902024-12-06T02:53:44.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84912024-12-06T02:53:44.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84922024-12-06T02:53:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84932024-12-06T02:53:44.592ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84942024-12-06T02:53:44.592ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84952024-12-06T02:53:44.592ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "87fa732b-6e0e-4593-98ce-f1bfc475fb98", "date": "Fri, 06 Dec 2024 02:53:44 GMT"} })
84962024-12-06T02:53:44.594ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
84972024-12-06T02:53:44.594ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
84982024-12-06T02:53:44.594ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 72.721217ms iteration = 26 status = {}
84992024-12-06T02:53:44.616ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85002024-12-06T02:53:44.616ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "65748a83-09e3-4a3f-a4ea-2bf09ba81017", "content-length": "691", "date": "Fri, 06 Dec 2024 02:53:44 GMT"} })
85012024-12-06T02:53:44.617ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85022024-12-06T02:53:44.617ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85032024-12-06T02:53:44.617ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85042024-12-06T02:53:44.618ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 96.011862ms iteration = 25 status = {}
85052024-12-06T02:53:44.622ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85062024-12-06T02:53:44.622ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85072024-12-06T02:53:44.627ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85082024-12-06T02:53:44.627ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85092024-12-06T02:53:44.630ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85102024-12-06T02:53:44.630ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85112024-12-06T02:53:44.633ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85122024-12-06T02:53:44.633ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85132024-12-06T02:53:44.635ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85142024-12-06T02:53:44.635ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85152024-12-06T02:53:44.636ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85162024-12-06T02:53:44.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85172024-12-06T02:53:44.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85182024-12-06T02:53:44.641ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 36adb3b8-4238-4eb5-8913-0041468585a1, lookup_type: ById(36adb3b8-4238-4eb5-8913-0041468585a1) }, key: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc, lookup_type: ById(e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc) }, key: ac2b3a9b-d712-4e39-8833-8cb85445305a, lookup_type: ById(ac2b3a9b-d712-4e39-8833-8cb85445305a) } result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85192024-12-06T02:53:44.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85202024-12-06T02:53:44.641ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_node = ChainSuccessorSaga
85212024-12-06T02:53:44.646ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update
85222024-12-06T02:53:44.646ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85232024-12-06T02:53:44.646ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85242024-12-06T02:53:44.646ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Signaled
85252024-12-06T02:53:44.646ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85262024-12-06T02:53:44.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85272024-12-06T02:53:44.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85282024-12-06T02:53:44.650ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85292024-12-06T02:53:44.650ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85302024-12-06T02:53:44.653ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85312024-12-06T02:53:44.653ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85322024-12-06T02:53:44.657ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85332024-12-06T02:53:44.657ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee
85342024-12-06T02:53:44.675ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85352024-12-06T02:53:44.675ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85362024-12-06T02:53:44.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85372024-12-06T02:53:44.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85382024-12-06T02:53:44.678ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85392024-12-06T02:53:44.678ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85402024-12-06T02:53:44.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85412024-12-06T02:53:44.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85422024-12-06T02:53:44.693ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85432024-12-06T02:53:44.693ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee saga_name = instance-update saga_result = SagaResult { saga_id: 818c4fc9-9dd5-49b2-aca6-22249018e5ee, saga_log: SagaLog { saga_id: 818c4fc9-9dd5-49b2-aca6-22249018e5ee, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a49492b7-8fe6-4dc4-ba20-9dad65813b63")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a49492b7-8fe6-4dc4-ba20-9dad65813b63")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("ac2b3a9b-d712-4e39-8833-8cb85445305a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3c341a9c-82c0-49f4-9e74-b3a3ba58635c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("ac2b3a9b-d712-4e39-8833-8cb85445305a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3c341a9c-82c0-49f4-9e74-b3a3ba58635c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a49492b7-8fe6-4dc4-ba20-9dad65813b63"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a49492b7-8fe6-4dc4-ba20-9dad65813b63")}} }) }
85442024-12-06T02:53:44.693ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 818c4fc9-9dd5-49b2-aca6-22249018e5ee instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update
85452024-12-06T02:53:44.693ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85462024-12-06T02:53:44.693ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
85472024-12-06T02:53:44.701ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85482024-12-06T02:53:44.701ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
85492024-12-06T02:53:44.713ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85502024-12-06T02:53:44.713ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85512024-12-06T02:53:44.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.356724ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85522024-12-06T02:53:44.764ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85532024-12-06T02:53:44.764ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
85542024-12-06T02:53:44.783ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85552024-12-06T02:53:44.783ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679
85562024-12-06T02:53:44.843ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update sec_id = 3943088e-6ce0-4ada-925c-494df92c0dda
85572024-12-06T02:53:44.843ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7e956ed6-750b-4655-bcd9-61dc51ad7679 saga_name = start-instance-update saga_result = SagaResult { saga_id: 7e956ed6-750b-4655-bcd9-61dc51ad7679, saga_log: SagaLog { saga_id: 7e956ed6-750b-4655-bcd9-61dc51ad7679, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("ca355813-d8ec-4f62-9448-8e1f752803fc")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ca355813-d8ec-4f62-9448-8e1f752803fc")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("ca355813-d8ec-4f62-9448-8e1f752803fc"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("ca355813-d8ec-4f62-9448-8e1f752803fc")}} }) }
85582024-12-06T02:53:44.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ad8c4cf2-0650-4315-b20c-59d5d0072122 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
85592024-12-06T02:53:44.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ad8c4cf2-0650-4315-b20c-59d5d0072122 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
85602024-12-06T02:53:44.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = ad8c4cf2-0650-4315-b20c-59d5d0072122 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
85612024-12-06T02:53:45.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = fe651de1-3d6c-4367-9781-bf2fcf03f543 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
85622024-12-06T02:53:45.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92bef602-e712-49fc-a183-d543655ccc99 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85632024-12-06T02:53:45.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92bef602-e712-49fc-a183-d543655ccc99 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85642024-12-06T02:53:45.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 92bef602-e712-49fc-a183-d543655ccc99 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85652024-12-06T02:53:46.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9b079cd9-9755-484e-9244-f99ab316123b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85662024-12-06T02:53:46.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9b079cd9-9755-484e-9244-f99ab316123b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85672024-12-06T02:53:46.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9b079cd9-9755-484e-9244-f99ab316123b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85682024-12-06T02:53:47.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3539aab0-89c4-4f59-9e4d-e3a8c7592549 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85692024-12-06T02:53:47.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3539aab0-89c4-4f59-9e4d-e3a8c7592549 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85702024-12-06T02:53:47.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3539aab0-89c4-4f59-9e4d-e3a8c7592549 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85712024-12-06T02:53:48.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 86fd2214-e59b-4b3f-aa70-1240cc7fa136 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85722024-12-06T02:53:48.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 86fd2214-e59b-4b3f-aa70-1240cc7fa136 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85732024-12-06T02:53:48.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 86fd2214-e59b-4b3f-aa70-1240cc7fa136 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85742024-12-06T02:53:49.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7932898-195e-42f5-80a9-c94f705f7909 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85752024-12-06T02:53:49.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7932898-195e-42f5-80a9-c94f705f7909 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85762024-12-06T02:53:49.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f7932898-195e-42f5-80a9-c94f705f7909 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85772024-12-06T02:53:50.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
85782024-12-06T02:53:50.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
85792024-12-06T02:53:50.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85802024-12-06T02:53:50.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85812024-12-06T02:53:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85822024-12-06T02:53:50.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85832024-12-06T02:53:50.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85842024-12-06T02:53:50.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85852024-12-06T02:53:50.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85862024-12-06T02:53:50.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.122139ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85872024-12-06T02:53:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85882024-12-06T02:53:50.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85892024-12-06T02:53:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85902024-12-06T02:53:50.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85912024-12-06T02:53:50.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85922024-12-06T02:53:50.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85932024-12-06T02:53:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
85942024-12-06T02:53:50.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85952024-12-06T02:53:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85962024-12-06T02:53:50.118ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
85972024-12-06T02:53:50.118ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.757707ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
85982024-12-06T02:53:50.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f55d9b97-73b0-4604-9389-c6055064446d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
85992024-12-06T02:53:50.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f55d9b97-73b0-4604-9389-c6055064446d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86002024-12-06T02:53:50.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f55d9b97-73b0-4604-9389-c6055064446d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86012024-12-06T02:53:51.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b363950-de63-4651-ab0d-593e4632c84d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86022024-12-06T02:53:51.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b363950-de63-4651-ab0d-593e4632c84d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86032024-12-06T02:53:51.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2b363950-de63-4651-ab0d-593e4632c84d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86042024-12-06T02:53:52.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 59755d21-5ae8-499c-9fc1-db350ea8f923 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86052024-12-06T02:53:52.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 59755d21-5ae8-499c-9fc1-db350ea8f923 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86062024-12-06T02:53:52.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 59755d21-5ae8-499c-9fc1-db350ea8f923 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86072024-12-06T02:53:53.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f1a5e20-eb1f-48c5-ad8e-81f7bec7124f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86082024-12-06T02:53:53.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f1a5e20-eb1f-48c5-ad8e-81f7bec7124f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86092024-12-06T02:53:53.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f1a5e20-eb1f-48c5-ad8e-81f7bec7124f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86102024-12-06T02:53:54.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0f45083c-78ed-4e7d-b74a-3fbd760a71d1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86112024-12-06T02:53:54.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0f45083c-78ed-4e7d-b74a-3fbd760a71d1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86122024-12-06T02:53:54.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0f45083c-78ed-4e7d-b74a-3fbd760a71d1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86132024-12-06T02:53:55.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1404 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = d11aa32b-4c51-4fbe-8155-877c3a268fd6 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
86142024-12-06T02:53:55.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d33dcca-b752-49e7-9e54-03930f0510f7 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86152024-12-06T02:53:55.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d33dcca-b752-49e7-9e54-03930f0510f7 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86162024-12-06T02:53:55.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4d33dcca-b752-49e7-9e54-03930f0510f7 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86172024-12-06T02:53:56.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9acecd80-9044-4b29-a79d-42d2de09432f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86182024-12-06T02:53:56.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9acecd80-9044-4b29-a79d-42d2de09432f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86192024-12-06T02:53:56.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9acecd80-9044-4b29-a79d-42d2de09432f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86202024-12-06T02:53:57.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 500d7318-f9be-4f09-9349-c87618498166 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86212024-12-06T02:53:57.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 500d7318-f9be-4f09-9349-c87618498166 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86222024-12-06T02:53:57.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 500d7318-f9be-4f09-9349-c87618498166 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86232024-12-06T02:53:58.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 838a1e8f-c037-4fa0-8414-dc61f9b82870 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86242024-12-06T02:53:58.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 838a1e8f-c037-4fa0-8414-dc61f9b82870 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86252024-12-06T02:53:58.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 838a1e8f-c037-4fa0-8414-dc61f9b82870 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86262024-12-06T02:53:59.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f752cfb0-c32e-4900-b239-e7ef2d09a6e9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86272024-12-06T02:53:59.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f752cfb0-c32e-4900-b239-e7ef2d09a6e9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86282024-12-06T02:53:59.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f752cfb0-c32e-4900-b239-e7ef2d09a6e9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
86292024-12-06T02:54:00.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 8f52e9fb-c793-42a4-ad3e-80430b6ac3b9 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
86302024-12-06T02:54:00.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 8f52e9fb-c793-42a4-ad3e-80430b6ac3b9 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
86312024-12-06T02:54:00.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 8f52e9fb-c793-42a4-ad3e-80430b6ac3b9 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
86322024-12-06T02:54:00.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 5e387690-1f35-4405-ab9f-cbfca6691e28 roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
86332024-12-06T02:54:00.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 5e387690-1f35-4405-ab9f-cbfca6691e28 resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
86342024-12-06T02:54:00.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 5e387690-1f35-4405-ab9f-cbfca6691e28 response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
86352024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
86362024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86372024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
86382024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
86392024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86402024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86412024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
86422024-12-06T02:54:00.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86432024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86442024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86452024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
86462024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
86472024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
86482024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86492024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86502024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
86512024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86522024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
86532024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
86542024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86552024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86562024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
86572024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86582024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
86592024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86602024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
86612024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86622024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86632024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
86642024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86652024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
86662024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86672024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86682024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
86692024-12-06T02:54:00.101ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
86702024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.821\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
86712024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
86722024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86732024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
86742024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86752024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
86762024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86772024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
86782024-12-06T02:54:00.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86792024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86802024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
86812024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86822024-12-06T02:54:00.101ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:44:00.101427097 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86832024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86842024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
86852024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86862024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
86872024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
86882024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
86892024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
86902024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
86912024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
86922024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
86932024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86942024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
86952024-12-06T02:54:00.101ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86962024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
86972024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86982024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86992024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87002024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
87012024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87022024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87032024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
87042024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87052024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87062024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87072024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87082024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87092024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87102024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87112024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87122024-12-06T02:54:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87132024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87142024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87152024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87162024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87172024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87182024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87192024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87202024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87212024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87222024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87232024-12-06T02:54:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6388, tv_nsec: 470171410 } })
87242024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87252024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
87262024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87272024-12-06T02:54:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6388, tv_nsec: 470198951 } })
87282024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87292024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87302024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
87312024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
87322024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.348709ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
87332024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87342024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
87352024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
87362024-12-06T02:54:00.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.347818ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
87372024-12-06T02:54:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87382024-12-06T02:54:00.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
87392024-12-06T02:54:00.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87402024-12-06T02:54:00.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87412024-12-06T02:54:00.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87422024-12-06T02:54:00.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87432024-12-06T02:54:00.108ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87442024-12-06T02:54:00.108ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87452024-12-06T02:54:00.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87462024-12-06T02:54:00.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87472024-12-06T02:54:00.108ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6388, tv_nsec: 476271574 } })
87482024-12-06T02:54:00.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87492024-12-06T02:54:00.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
87502024-12-06T02:54:00.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87512024-12-06T02:54:00.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87522024-12-06T02:54:00.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87532024-12-06T02:54:00.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87542024-12-06T02:54:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87552024-12-06T02:54:00.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87562024-12-06T02:54:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87572024-12-06T02:54:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87582024-12-06T02:54:00.111ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.457218ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87592024-12-06T02:54:00.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87602024-12-06T02:54:00.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87612024-12-06T02:54:00.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87622024-12-06T02:54:00.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87632024-12-06T02:54:00.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87642024-12-06T02:54:00.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87652024-12-06T02:54:00.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87662024-12-06T02:54:00.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87672024-12-06T02:54:00.118ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87682024-12-06T02:54:00.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87692024-12-06T02:54:00.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87702024-12-06T02:54:00.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87712024-12-06T02:54:00.126ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6388, tv_nsec: 494015460 } })
87722024-12-06T02:54:00.126ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
87732024-12-06T02:54:00.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 28.612207ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
87742024-12-06T02:54:00.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87752024-12-06T02:54:00.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87762024-12-06T02:54:00.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87772024-12-06T02:54:00.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87782024-12-06T02:54:00.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87792024-12-06T02:54:00.138ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 36.831472ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
87802024-12-06T02:54:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
87812024-12-06T02:54:00.139ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
87822024-12-06T02:54:00.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87832024-12-06T02:54:00.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87842024-12-06T02:54:00.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
87852024-12-06T02:54:00.144ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
87862024-12-06T02:54:00.144ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:44:00.101427097 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87872024-12-06T02:54:00.144ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 43.281306ms iteration = 13 status = {"expiration":"2024-12-06T02:44:00.101427097Z","pruned":[]}
87882024-12-06T02:54:00.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
87892024-12-06T02:54:00.153ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
87902024-12-06T02:54:00.153ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
87912024-12-06T02:54:00.153ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.649754ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
87922024-12-06T02:54:00.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87932024-12-06T02:54:00.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87942024-12-06T02:54:00.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87952024-12-06T02:54:00.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87962024-12-06T02:54:00.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87972024-12-06T02:54:00.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87982024-12-06T02:54:00.172ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6388, tv_nsec: 540126487 } })
87992024-12-06T02:54:00.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88002024-12-06T02:54:00.173ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
88012024-12-06T02:54:00.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88022024-12-06T02:54:00.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88032024-12-06T02:54:00.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88042024-12-06T02:54:00.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88052024-12-06T02:54:00.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88062024-12-06T02:54:00.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88072024-12-06T02:54:00.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88082024-12-06T02:54:00.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88092024-12-06T02:54:00.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88102024-12-06T02:54:00.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88112024-12-06T02:54:00.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88122024-12-06T02:54:00.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88132024-12-06T02:54:00.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88142024-12-06T02:54:00.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88152024-12-06T02:54:00.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88162024-12-06T02:54:00.219ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172024-12-06T02:54:00.221ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88182024-12-06T02:54:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88192024-12-06T02:54:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88202024-12-06T02:54:00.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88212024-12-06T02:54:00.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88222024-12-06T02:54:00.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88232024-12-06T02:54:00.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
88242024-12-06T02:54:00.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88252024-12-06T02:54:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88262024-12-06T02:54:00.226ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88272024-12-06T02:54:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88282024-12-06T02:54:00.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88292024-12-06T02:54:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88302024-12-06T02:54:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88312024-12-06T02:54:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
88322024-12-06T02:54:00.229ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88332024-12-06T02:54:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88342024-12-06T02:54:00.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88352024-12-06T02:54:00.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 128.947142ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
88362024-12-06T02:54:00.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 131.956018ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88372024-12-06T02:54:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88382024-12-06T02:54:00.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88392024-12-06T02:54:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88402024-12-06T02:54:00.233ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88412024-12-06T02:54:00.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88422024-12-06T02:54:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88432024-12-06T02:54:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
88442024-12-06T02:54:00.236ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88452024-12-06T02:54:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88462024-12-06T02:54:00.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88472024-12-06T02:54:00.239ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88482024-12-06T02:54:00.240ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88492024-12-06T02:54:00.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88502024-12-06T02:54:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
88512024-12-06T02:54:00.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88522024-12-06T02:54:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88532024-12-06T02:54:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88542024-12-06T02:54:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 141.585644ms iteration = 6 status = {"nsuccess":5}
88552024-12-06T02:54:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.966414ms iteration = 29 status = {"physical_disks_added":0}
88562024-12-06T02:54:00.246ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88572024-12-06T02:54:00.246ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88582024-12-06T02:54:00.246ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5e19046-1d9d-4c85-9010-caec096fdbde", "content-length": "26", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
88592024-12-06T02:54:00.246ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88602024-12-06T02:54:00.248ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88612024-12-06T02:54:00.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 146.925475ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
88622024-12-06T02:54:00.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88632024-12-06T02:54:00.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88642024-12-06T02:54:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88652024-12-06T02:54:00.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88662024-12-06T02:54:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88672024-12-06T02:54:00.279ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88682024-12-06T02:54:00.279ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88692024-12-06T02:54:00.279ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88702024-12-06T02:54:00.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88712024-12-06T02:54:00.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88722024-12-06T02:54:00.280ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88732024-12-06T02:54:00.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742024-12-06T02:54:00.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
88752024-12-06T02:54:00.282ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88762024-12-06T02:54:00.283ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c8b402-fb55-4350-b612-06b386606f5a", "content-length": "26", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
88772024-12-06T02:54:00.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88782024-12-06T02:54:00.285ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
88792024-12-06T02:54:00.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88802024-12-06T02:54:00.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88812024-12-06T02:54:00.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88822024-12-06T02:54:00.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88832024-12-06T02:54:00.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88842024-12-06T02:54:00.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88852024-12-06T02:54:00.293ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88862024-12-06T02:54:00.293ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88872024-12-06T02:54:00.293ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 191.637083ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88882024-12-06T02:54:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
88892024-12-06T02:54:00.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88902024-12-06T02:54:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88912024-12-06T02:54:00.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88922024-12-06T02:54:00.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88932024-12-06T02:54:00.299ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88942024-12-06T02:54:00.299ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88952024-12-06T02:54:00.299ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.266192ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88962024-12-06T02:54:00.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 198.367185ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88972024-12-06T02:54:00.299ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88982024-12-06T02:54:00.299ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88992024-12-06T02:54:00.300ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89002024-12-06T02:54:00.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89012024-12-06T02:54:00.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89022024-12-06T02:54:00.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89032024-12-06T02:54:00.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 201.947077ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89042024-12-06T02:54:00.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89052024-12-06T02:54:00.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89062024-12-06T02:54:00.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89072024-12-06T02:54:00.309ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
89082024-12-06T02:54:00.309ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 208.552416ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
89092024-12-06T02:54:00.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89102024-12-06T02:54:00.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
89112024-12-06T02:54:00.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89122024-12-06T02:54:00.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89132024-12-06T02:54:00.321ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 220.256821ms iteration = 25 status = 0
89142024-12-06T02:54:00.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.146535ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89152024-12-06T02:54:00.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89162024-12-06T02:54:00.341ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89172024-12-06T02:54:00.342ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bde29be-75bd-4fa0-bc66-451f6c5ee1c2", "content-length": "26", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
89182024-12-06T02:54:00.342ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89192024-12-06T02:54:00.344ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89202024-12-06T02:54:00.344ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
89212024-12-06T02:54:00.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89222024-12-06T02:54:00.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89232024-12-06T02:54:00.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89242024-12-06T02:54:00.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89252024-12-06T02:54:00.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89262024-12-06T02:54:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89272024-12-06T02:54:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89282024-12-06T02:54:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89292024-12-06T02:54:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89302024-12-06T02:54:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89312024-12-06T02:54:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89322024-12-06T02:54:00.359ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
89332024-12-06T02:54:00.359ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89342024-12-06T02:54:00.359ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
89352024-12-06T02:54:00.359ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 258.129012ms iteration = 14 status = {"generation":2}
89362024-12-06T02:54:00.367ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
89372024-12-06T02:54:00.367ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 266.324956ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89382024-12-06T02:54:00.378ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89392024-12-06T02:54:00.378ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 277.900847ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89402024-12-06T02:54:00.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89412024-12-06T02:54:00.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89422024-12-06T02:54:00.449ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89432024-12-06T02:54:00.450ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89442024-12-06T02:54:00.526ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89452024-12-06T02:54:00.526ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ca567a4-9128-4616-808a-cf428560be44", "content-length": "2", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
89462024-12-06T02:54:00.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89472024-12-06T02:54:00.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89482024-12-06T02:54:00.532ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89492024-12-06T02:54:00.532ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89502024-12-06T02:54:00.533ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b7ad2de-00d1-44c4-96e8-f1a2d28141fc", "content-length": "372", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
89512024-12-06T02:54:00.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89522024-12-06T02:54:00.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89532024-12-06T02:54:00.534ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89542024-12-06T02:54:00.534ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89552024-12-06T02:54:00.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89562024-12-06T02:54:00.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89572024-12-06T02:54:00.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89582024-12-06T02:54:00.535ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 434.615263ms iteration = 25 status = null
89592024-12-06T02:54:00.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89602024-12-06T02:54:00.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89612024-12-06T02:54:00.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89622024-12-06T02:54:00.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89632024-12-06T02:54:00.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89642024-12-06T02:54:00.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89652024-12-06T02:54:00.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89662024-12-06T02:54:00.540ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
89672024-12-06T02:54:00.540ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89682024-12-06T02:54:00.540ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
89692024-12-06T02:54:00.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 440.317447ms iteration = 14 status = {"generation":1}
89702024-12-06T02:54:00.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89712024-12-06T02:54:00.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89722024-12-06T02:54:00.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89732024-12-06T02:54:00.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89742024-12-06T02:54:00.590ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89752024-12-06T02:54:00.590ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89762024-12-06T02:54:00.590ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3a0c047a-1d32-477d-8493-ba642ebfddf1", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
89772024-12-06T02:54:00.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89782024-12-06T02:54:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89792024-12-06T02:54:00.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89802024-12-06T02:54:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89812024-12-06T02:54:00.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89822024-12-06T02:54:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89832024-12-06T02:54:00.598ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89842024-12-06T02:54:00.598ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "83520a3a-54fc-4b33-9877-b5686fcd1a58", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89852024-12-06T02:54:00.598ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89862024-12-06T02:54:00.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f28bc5df-8dba-4492-8b6b-5c246388e3b7", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89872024-12-06T02:54:00.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89882024-12-06T02:54:00.600ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89892024-12-06T02:54:00.600ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89902024-12-06T02:54:00.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e1d7de44-9b40-4f51-91a3-a2798c57ff4c", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89912024-12-06T02:54:00.602ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89922024-12-06T02:54:00.603ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 501.777432ms iteration = 25 status = {}
89932024-12-06T02:54:00.604ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
89942024-12-06T02:54:00.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 503.535922ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89952024-12-06T02:54:00.680ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89962024-12-06T02:54:00.680ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "14b0ab4d-4c29-404d-8c65-0560bce08589", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89972024-12-06T02:54:00.680ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89982024-12-06T02:54:00.683ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "837a62f3-b0bd-482d-b17e-e72385f73f4e", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89992024-12-06T02:54:00.683ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90002024-12-06T02:54:00.685ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90012024-12-06T02:54:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 583.725612ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90022024-12-06T02:54:00.695ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "13dac21d-5d55-4ec1-a121-6d9de4a5e361", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90032024-12-06T02:54:00.697ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 596.089776ms iteration = 27 status = {}
90042024-12-06T02:54:00.702ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90052024-12-06T02:54:00.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7df2c492-0299-4f3d-9baf-736c3cff66fd", "content-length": "691", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90062024-12-06T02:54:00.703ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90072024-12-06T02:54:00.703ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90082024-12-06T02:54:00.703ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90092024-12-06T02:54:00.705ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 604.369533ms iteration = 26 status = {}
90102024-12-06T02:54:00.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90112024-12-06T02:54:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90122024-12-06T02:54:00.739ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
90132024-12-06T02:54:00.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90142024-12-06T02:54:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90152024-12-06T02:54:00.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90162024-12-06T02:54:00.749ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a38a5744-0dac-458d-bc69-92da909e5052", "content-length": "134", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90172024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90182024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
90192024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90202024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90212024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90222024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90232024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90242024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90252024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90262024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90272024-12-06T02:54:00.750ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
90282024-12-06T02:54:00.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90292024-12-06T02:54:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90302024-12-06T02:54:00.752ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90312024-12-06T02:54:00.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "014f1c88-4ccf-4f9b-b89c-a4c44a2a50b6", "content-length": "2", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90322024-12-06T02:54:00.752ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90332024-12-06T02:54:00.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1332e6f4-9015-4904-86be-1ea429990787", "content-length": "52", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90342024-12-06T02:54:00.752ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
90352024-12-06T02:54:00.752ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90362024-12-06T02:54:00.903ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "244e8b70-3a90-4b05-b4a5-0a531480183e", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90372024-12-06T02:54:00.903ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
90382024-12-06T02:54:00.903ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90392024-12-06T02:54:00.903ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "519ef1fd-b43d-4bbc-95f8-ab2f814a95ec", "content-length": "682", "date": "Fri, 06 Dec 2024 02:54:00 GMT"} })
90402024-12-06T02:54:00.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90412024-12-06T02:54:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90422024-12-06T02:54:00.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90432024-12-06T02:54:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90442024-12-06T02:54:00.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90452024-12-06T02:54:00.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90462024-12-06T02:54:00.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90472024-12-06T02:54:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90482024-12-06T02:54:00.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7ca6c404-1476-4079-b36f-162218e021be roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90492024-12-06T02:54:00.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7ca6c404-1476-4079-b36f-162218e021be resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90502024-12-06T02:54:00.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7ca6c404-1476-4079-b36f-162218e021be response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90512024-12-06T02:54:00.920ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 819.350893ms iteration = 25 status = {}
90522024-12-06T02:54:01.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6799d34b-25d2-4bed-9683-bb6fed9f1301 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90532024-12-06T02:54:01.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6799d34b-25d2-4bed-9683-bb6fed9f1301 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90542024-12-06T02:54:01.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6799d34b-25d2-4bed-9683-bb6fed9f1301 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90552024-12-06T02:54:02.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 390c58ca-2572-4d8a-a3d7-62b6ad2acc7e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90562024-12-06T02:54:02.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 390c58ca-2572-4d8a-a3d7-62b6ad2acc7e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90572024-12-06T02:54:02.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 390c58ca-2572-4d8a-a3d7-62b6ad2acc7e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90582024-12-06T02:54:03.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1e4f5a7d-dbd7-4191-ac08-8be857a3e8c4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90592024-12-06T02:54:03.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1e4f5a7d-dbd7-4191-ac08-8be857a3e8c4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90602024-12-06T02:54:03.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 1e4f5a7d-dbd7-4191-ac08-8be857a3e8c4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90612024-12-06T02:54:05.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc8f4804-82e4-4cf2-89f3-36cc4e3134fe roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90622024-12-06T02:54:05.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc8f4804-82e4-4cf2-89f3-36cc4e3134fe resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90632024-12-06T02:54:05.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bc8f4804-82e4-4cf2-89f3-36cc4e3134fe response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90642024-12-06T02:54:05.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1235 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 9bfb438c-a12c-441e-9b16-5c753b5c7ef4 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
90652024-12-06T02:54:06.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ea8f2713-2fe9-4f07-9db6-5d26c3c2c544 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90662024-12-06T02:54:06.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ea8f2713-2fe9-4f07-9db6-5d26c3c2c544 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90672024-12-06T02:54:06.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ea8f2713-2fe9-4f07-9db6-5d26c3c2c544 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90682024-12-06T02:54:07.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e30aece-fd60-43b5-ab06-cdae2a6f013d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90692024-12-06T02:54:07.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e30aece-fd60-43b5-ab06-cdae2a6f013d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90702024-12-06T02:54:07.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e30aece-fd60-43b5-ab06-cdae2a6f013d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90712024-12-06T02:54:08.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c8c0339e-685e-4506-98e9-30cc8b195ead roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90722024-12-06T02:54:08.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c8c0339e-685e-4506-98e9-30cc8b195ead resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90732024-12-06T02:54:08.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c8c0339e-685e-4506-98e9-30cc8b195ead response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90742024-12-06T02:54:09.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3d8ab455-d47a-4386-816f-9aae3015f496 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90752024-12-06T02:54:09.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3d8ab455-d47a-4386-816f-9aae3015f496 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90762024-12-06T02:54:09.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3d8ab455-d47a-4386-816f-9aae3015f496 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90772024-12-06T02:54:10.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
90782024-12-06T02:54:10.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90792024-12-06T02:54:10.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
90802024-12-06T02:54:10.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90812024-12-06T02:54:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90822024-12-06T02:54:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90832024-12-06T02:54:10.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90842024-12-06T02:54:10.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90852024-12-06T02:54:10.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90862024-12-06T02:54:10.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90872024-12-06T02:54:10.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90882024-12-06T02:54:10.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90892024-12-06T02:54:10.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90902024-12-06T02:54:10.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c3046569-b8d7-4e87-b945-2d4cac52dbf8 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90912024-12-06T02:54:10.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c3046569-b8d7-4e87-b945-2d4cac52dbf8 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90922024-12-06T02:54:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
90932024-12-06T02:54:10.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90942024-12-06T02:54:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90952024-12-06T02:54:10.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c3046569-b8d7-4e87-b945-2d4cac52dbf8 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
90962024-12-06T02:54:10.121ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
90972024-12-06T02:54:10.121ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.104542ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
90982024-12-06T02:54:10.138ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90992024-12-06T02:54:10.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91002024-12-06T02:54:10.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.852229ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91012024-12-06T02:54:11.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4055938f-8cbd-4709-ad57-994ae098f3fa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91022024-12-06T02:54:11.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4055938f-8cbd-4709-ad57-994ae098f3fa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91032024-12-06T02:54:11.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4055938f-8cbd-4709-ad57-994ae098f3fa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91042024-12-06T02:54:12.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a9a7eb4-7cd6-4cc0-9560-7a41d571d356 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91052024-12-06T02:54:12.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a9a7eb4-7cd6-4cc0-9560-7a41d571d356 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91062024-12-06T02:54:12.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a9a7eb4-7cd6-4cc0-9560-7a41d571d356 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91072024-12-06T02:54:13.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f4b8618-a23a-40b1-954b-8ab1865bf5e5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91082024-12-06T02:54:13.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f4b8618-a23a-40b1-954b-8ab1865bf5e5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91092024-12-06T02:54:13.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f4b8618-a23a-40b1-954b-8ab1865bf5e5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91102024-12-06T02:54:14.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d748d93-b1eb-4792-9d15-65cae4a0d5b1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91112024-12-06T02:54:14.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d748d93-b1eb-4792-9d15-65cae4a0d5b1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91122024-12-06T02:54:14.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5d748d93-b1eb-4792-9d15-65cae4a0d5b1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91132024-12-06T02:54:14.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = f8c3649f-7481-4e0b-907a-fdd840823c20 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
91142024-12-06T02:54:14.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = f8c3649f-7481-4e0b-907a-fdd840823c20 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
91152024-12-06T02:54:14.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = f8c3649f-7481-4e0b-907a-fdd840823c20 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
91162024-12-06T02:54:15.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1399 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 1269edb7-50ac-4034-9608-bbe619bc0016 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
91172024-12-06T02:54:15.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b22b3048-01d4-46af-b139-da3272bd186d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91182024-12-06T02:54:15.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b22b3048-01d4-46af-b139-da3272bd186d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91192024-12-06T02:54:15.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b22b3048-01d4-46af-b139-da3272bd186d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91202024-12-06T02:54:16.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3ab94a59-d664-4588-9ba0-af7c016b1a77 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91212024-12-06T02:54:16.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3ab94a59-d664-4588-9ba0-af7c016b1a77 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91222024-12-06T02:54:16.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3ab94a59-d664-4588-9ba0-af7c016b1a77 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91232024-12-06T02:54:17.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a68789a2-118b-4ee9-acc7-1481c000ee16 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91242024-12-06T02:54:17.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a68789a2-118b-4ee9-acc7-1481c000ee16 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91252024-12-06T02:54:17.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a68789a2-118b-4ee9-acc7-1481c000ee16 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91262024-12-06T02:54:18.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6048da48-a4ec-427f-b025-d7586dfc4cad roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91272024-12-06T02:54:18.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6048da48-a4ec-427f-b025-d7586dfc4cad resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91282024-12-06T02:54:18.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6048da48-a4ec-427f-b025-d7586dfc4cad response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91292024-12-06T02:54:19.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c86c8da1-0d16-4568-9e4d-5779e54ec8bc roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91302024-12-06T02:54:19.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c86c8da1-0d16-4568-9e4d-5779e54ec8bc resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91312024-12-06T02:54:19.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c86c8da1-0d16-4568-9e4d-5779e54ec8bc response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91322024-12-06T02:54:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
91332024-12-06T02:54:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91342024-12-06T02:54:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
91352024-12-06T02:54:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91362024-12-06T02:54:20.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91372024-12-06T02:54:20.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91382024-12-06T02:54:20.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91392024-12-06T02:54:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91402024-12-06T02:54:20.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91412024-12-06T02:54:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91422024-12-06T02:54:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91432024-12-06T02:54:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91442024-12-06T02:54:20.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91452024-12-06T02:54:20.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
91462024-12-06T02:54:20.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91472024-12-06T02:54:20.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91482024-12-06T02:54:20.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
91492024-12-06T02:54:20.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.407199ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
91502024-12-06T02:54:20.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91512024-12-06T02:54:20.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91522024-12-06T02:54:20.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.310816ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91532024-12-06T02:54:20.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f39ac041-7250-4a7f-a1fd-34d3e9d88c65 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91542024-12-06T02:54:20.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f39ac041-7250-4a7f-a1fd-34d3e9d88c65 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91552024-12-06T02:54:20.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f39ac041-7250-4a7f-a1fd-34d3e9d88c65 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91562024-12-06T02:54:21.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3671ba6d-8acb-4afc-b10c-6a7b24ac674b roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91572024-12-06T02:54:21.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3671ba6d-8acb-4afc-b10c-6a7b24ac674b resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91582024-12-06T02:54:21.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3671ba6d-8acb-4afc-b10c-6a7b24ac674b response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91592024-12-06T02:54:22.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6371185f-1ece-40a1-8fb0-2a7766d04e9f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91602024-12-06T02:54:22.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6371185f-1ece-40a1-8fb0-2a7766d04e9f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91612024-12-06T02:54:22.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6371185f-1ece-40a1-8fb0-2a7766d04e9f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91622024-12-06T02:54:23.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0a8de14-2b91-4898-be6b-ed60fe3ac429 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91632024-12-06T02:54:23.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0a8de14-2b91-4898-be6b-ed60fe3ac429 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91642024-12-06T02:54:23.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a0a8de14-2b91-4898-be6b-ed60fe3ac429 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91652024-12-06T02:54:24.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dfb582fb-f0ef-4587-9f2e-e0213da58eeb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91662024-12-06T02:54:24.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dfb582fb-f0ef-4587-9f2e-e0213da58eeb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91672024-12-06T02:54:24.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dfb582fb-f0ef-4587-9f2e-e0213da58eeb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91682024-12-06T02:54:25.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1266 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 3f499317-a764-422a-9021-c2fe42c6aa89 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
91692024-12-06T02:54:25.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab5a7895-de8e-4ffe-8f2d-9bb6cbaba00d roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91702024-12-06T02:54:25.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab5a7895-de8e-4ffe-8f2d-9bb6cbaba00d resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91712024-12-06T02:54:25.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ab5a7895-de8e-4ffe-8f2d-9bb6cbaba00d response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91722024-12-06T02:54:26.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 991eeb99-6c90-411b-a5d4-75ed5de6a4b4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91732024-12-06T02:54:26.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 991eeb99-6c90-411b-a5d4-75ed5de6a4b4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91742024-12-06T02:54:26.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 991eeb99-6c90-411b-a5d4-75ed5de6a4b4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91752024-12-06T02:54:27.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72f33279-0f43-4629-9ec2-c6295ec94aec roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91762024-12-06T02:54:27.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72f33279-0f43-4629-9ec2-c6295ec94aec resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91772024-12-06T02:54:27.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 72f33279-0f43-4629-9ec2-c6295ec94aec response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91782024-12-06T02:54:28.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 089b7d5d-a653-4d3a-8ce9-0d42e9e06ad9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91792024-12-06T02:54:28.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 089b7d5d-a653-4d3a-8ce9-0d42e9e06ad9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91802024-12-06T02:54:28.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 089b7d5d-a653-4d3a-8ce9-0d42e9e06ad9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91812024-12-06T02:54:29.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e0ddd22-1462-4217-aa39-50fb7f4074c9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91822024-12-06T02:54:29.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e0ddd22-1462-4217-aa39-50fb7f4074c9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91832024-12-06T02:54:29.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 8e0ddd22-1462-4217-aa39-50fb7f4074c9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
91842024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
91852024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91862024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
91872024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
91882024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91892024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91902024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
91912024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91922024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
91932024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
91942024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91952024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91962024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91972024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
91982024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
91992024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92002024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
92012024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
92022024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92032024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92042024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
92052024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
92062024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92072024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92082024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
92092024-12-06T02:54:30.100ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92102024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92112024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92122024-12-06T02:54:30.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92132024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92142024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92152024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92162024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92172024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92182024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92192024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92202024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92212024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92222024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92232024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
92242024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
92252024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92262024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92272024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
92282024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92292024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
92302024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92312024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92322024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92332024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92342024-12-06T02:54:30.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92352024-12-06T02:54:30.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92362024-12-06T02:54:30.105ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.629751ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92372024-12-06T02:54:30.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92382024-12-06T02:54:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92392024-12-06T02:54:30.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92402024-12-06T02:54:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92412024-12-06T02:54:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92422024-12-06T02:54:30.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92432024-12-06T02:54:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92442024-12-06T02:54:30.111ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6418, tv_nsec: 479500634 } })
92452024-12-06T02:54:30.112ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92462024-12-06T02:54:30.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92472024-12-06T02:54:30.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92482024-12-06T02:54:30.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92492024-12-06T02:54:30.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6418, tv_nsec: 484472356 } })
92502024-12-06T02:54:30.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92512024-12-06T02:54:30.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92522024-12-06T02:54:30.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92532024-12-06T02:54:30.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92542024-12-06T02:54:30.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6418, tv_nsec: 493892305 } })
92552024-12-06T02:54:30.126ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
92562024-12-06T02:54:30.154ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92572024-12-06T02:54:30.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92582024-12-06T02:54:30.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92592024-12-06T02:54:30.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92602024-12-06T02:54:30.172ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92612024-12-06T02:54:30.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92622024-12-06T02:54:30.173ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92632024-12-06T02:54:30.173ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92642024-12-06T02:54:30.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92652024-12-06T02:54:30.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92662024-12-06T02:54:30.176ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92672024-12-06T02:54:30.176ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92682024-12-06T02:54:30.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92692024-12-06T02:54:30.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92702024-12-06T02:54:30.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92712024-12-06T02:54:30.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92722024-12-06T02:54:30.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92732024-12-06T02:54:30.180ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92742024-12-06T02:54:30.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92752024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92762024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92772024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92782024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92792024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92802024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92812024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92822024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92832024-12-06T02:54:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92842024-12-06T02:54:30.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.541973ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
92852024-12-06T02:54:30.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92862024-12-06T02:54:30.188ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92872024-12-06T02:54:30.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92882024-12-06T02:54:30.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92892024-12-06T02:54:30.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.730406ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
92902024-12-06T02:54:30.193ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92912024-12-06T02:54:30.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92922024-12-06T02:54:30.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92932024-12-06T02:54:30.196ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92942024-12-06T02:54:30.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92952024-12-06T02:54:30.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
92962024-12-06T02:54:30.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92972024-12-06T02:54:30.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92982024-12-06T02:54:30.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92992024-12-06T02:54:30.198ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93002024-12-06T02:54:30.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93012024-12-06T02:54:30.198ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bf28190-df8c-4f80-9b22-8f9253640fe8", "content-length": "26", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
93022024-12-06T02:54:30.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93032024-12-06T02:54:30.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93042024-12-06T02:54:30.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93052024-12-06T02:54:30.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93062024-12-06T02:54:30.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93072024-12-06T02:54:30.212ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.699908ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93082024-12-06T02:54:30.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
93092024-12-06T02:54:30.215ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93102024-12-06T02:54:30.216ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0238f391-d236-484a-abab-796910f2b282", "content-length": "26", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
93112024-12-06T02:54:30.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93122024-12-06T02:54:30.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
93132024-12-06T02:54:30.224ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93142024-12-06T02:54:30.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.641652ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93152024-12-06T02:54:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93162024-12-06T02:54:30.230ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
93172024-12-06T02:54:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.572809ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
93182024-12-06T02:54:30.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.261337ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93192024-12-06T02:54:30.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93202024-12-06T02:54:30.234ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93212024-12-06T02:54:30.234ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d2c27d6-fb12-43bf-a818-92719bf197d5", "content-length": "26", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
93222024-12-06T02:54:30.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93232024-12-06T02:54:30.236ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93242024-12-06T02:54:30.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93252024-12-06T02:54:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93262024-12-06T02:54:30.239ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93272024-12-06T02:54:30.239ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93282024-12-06T02:54:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.307439ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93292024-12-06T02:54:30.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93302024-12-06T02:54:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93312024-12-06T02:54:30.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93322024-12-06T02:54:30.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93332024-12-06T02:54:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93342024-12-06T02:54:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
93352024-12-06T02:54:30.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93362024-12-06T02:54:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93372024-12-06T02:54:30.247ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93382024-12-06T02:54:30.247ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 147.207034ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93392024-12-06T02:54:30.249ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 149.359756ms iteration = 26 status = 0
93402024-12-06T02:54:30.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.3254ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93412024-12-06T02:54:30.279ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93422024-12-06T02:54:30.279ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c15f24f6-cf94-463e-9c8f-b6eb143bf105", "content-length": "2", "date": "Fri, 06 Dec 2024 02:54:29 GMT"} })
93432024-12-06T02:54:30.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93442024-12-06T02:54:30.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93452024-12-06T02:54:30.287ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 186.840216ms iteration = 26 status = null
93462024-12-06T02:54:30.319ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 219.587702ms iteration = 30 status = {"physical_disks_added":0}
93472024-12-06T02:54:30.326ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.055726ms iteration = 26 status = {}
93482024-12-06T02:54:30.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93492024-12-06T02:54:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93502024-12-06T02:54:30.363ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93512024-12-06T02:54:30.363ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93522024-12-06T02:54:30.366ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "97b5d72f-2b0e-4926-aa2b-0aa83acb9f12", "content-length": "372", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
93532024-12-06T02:54:30.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93542024-12-06T02:54:30.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93552024-12-06T02:54:30.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-12-06T02:54:30.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93572024-12-06T02:54:30.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93582024-12-06T02:54:30.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93592024-12-06T02:54:30.384ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93602024-12-06T02:54:30.384ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93612024-12-06T02:54:30.384ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb0307bb-a066-45a9-b57d-ca184fcdb32c", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
93622024-12-06T02:54:30.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93632024-12-06T02:54:30.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93642024-12-06T02:54:30.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93652024-12-06T02:54:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93662024-12-06T02:54:30.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93672024-12-06T02:54:30.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93682024-12-06T02:54:30.394ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93692024-12-06T02:54:30.394ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93702024-12-06T02:54:30.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93712024-12-06T02:54:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93722024-12-06T02:54:30.400ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
93732024-12-06T02:54:30.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93742024-12-06T02:54:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93752024-12-06T02:54:30.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93762024-12-06T02:54:30.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93772024-12-06T02:54:30.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a52a0051-b0e0-433d-b9cf-43066cd3be81", "content-length": "134", "date": "Fri, 06 Dec 2024 02:54:29 GMT"} })
93782024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93792024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
93802024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93812024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93822024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93832024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93842024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93852024-12-06T02:54:30.415ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93862024-12-06T02:54:30.416ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93872024-12-06T02:54:30.416ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93882024-12-06T02:54:30.416ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
93892024-12-06T02:54:30.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93902024-12-06T02:54:30.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93912024-12-06T02:54:30.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93922024-12-06T02:54:30.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93932024-12-06T02:54:30.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93942024-12-06T02:54:30.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93952024-12-06T02:54:30.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d63b146-7b79-454c-8108-8b7d95802f40", "content-length": "2", "date": "Fri, 06 Dec 2024 02:54:29 GMT"} })
93962024-12-06T02:54:30.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93972024-12-06T02:54:30.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e66e66d7-b3e3-4e57-9000-538c657bad21", "content-length": "52", "date": "Fri, 06 Dec 2024 02:54:29 GMT"} })
93982024-12-06T02:54:30.418ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
93992024-12-06T02:54:30.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94002024-12-06T02:54:30.450ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94012024-12-06T02:54:30.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "19b46ab9-c9a5-4f23-805e-c5e7eb44bcb5", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
94022024-12-06T02:54:30.491ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.325798ms iteration = 28 status = {}
94032024-12-06T02:54:30.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9fdc368-4013-4dcb-8df3-6e3092a163fc", "content-length": "691", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
94042024-12-06T02:54:30.491ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94052024-12-06T02:54:30.491ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94062024-12-06T02:54:30.491ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94072024-12-06T02:54:30.493ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.883202ms iteration = 27 status = {}
94082024-12-06T02:54:30.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d05d09b4-a754-462f-8293-9b1a1dc3b1bb roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94092024-12-06T02:54:30.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d05d09b4-a754-462f-8293-9b1a1dc3b1bb resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94102024-12-06T02:54:30.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = d05d09b4-a754-462f-8293-9b1a1dc3b1bb response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94112024-12-06T02:54:30.673ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d734e941-808e-4cbf-a99d-29e90a28a507", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
94122024-12-06T02:54:30.673ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
94132024-12-06T02:54:30.673ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94142024-12-06T02:54:30.674ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c955860-f09e-4047-b196-5124c6edcb6f", "content-length": "682", "date": "Fri, 06 Dec 2024 02:54:30 GMT"} })
94152024-12-06T02:54:30.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94162024-12-06T02:54:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94172024-12-06T02:54:30.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94182024-12-06T02:54:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94192024-12-06T02:54:30.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94202024-12-06T02:54:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94212024-12-06T02:54:30.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94222024-12-06T02:54:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94232024-12-06T02:54:30.691ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 591.458254ms iteration = 26 status = {}
94242024-12-06T02:54:30.724ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:57417
94252024-12-06T02:54:30.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57417 req_id = 014902cb-2e9b-41c6-ba5c-e5c11a1b9d6a roles = RoleSet { roles: {} } uri = /metrics/producers
94262024-12-06T02:54:30.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57417 req_id = 014902cb-2e9b-41c6-ba5c-e5c11a1b9d6a resource = Database result = Ok(()) uri = /metrics/producers
94272024-12-06T02:54:30.759ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 6379dfe0-2a46-4638-967d-13828cc17f6c
94282024-12-06T02:54:30.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34425 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57417 req_id = 014902cb-2e9b-41c6-ba5c-e5c11a1b9d6a response_code = 201 uri = /metrics/producers
94292024-12-06T02:54:30.932ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50118
94302024-12-06T02:54:30.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50118 req_id = 640ad19a-c4b4-4e56-ad0b-24786ce8cb8a roles = RoleSet { roles: {} } uri = /metrics/producers
94312024-12-06T02:54:30.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50118 req_id = 640ad19a-c4b4-4e56-ad0b-24786ce8cb8a resource = Database result = Ok(()) uri = /metrics/producers
94322024-12-06T02:54:30.967ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3c6a3a2f-feb7-45e4-8652-d9c5f1a56f83
94332024-12-06T02:54:30.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35051 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50118 req_id = 640ad19a-c4b4-4e56-ad0b-24786ce8cb8a response_code = 201 uri = /metrics/producers
94342024-12-06T02:54:31.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6424852a-fd36-4622-8468-de67eefd5bb2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94352024-12-06T02:54:31.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6424852a-fd36-4622-8468-de67eefd5bb2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94362024-12-06T02:54:31.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6424852a-fd36-4622-8468-de67eefd5bb2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94372024-12-06T02:54:31.992ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35736
94382024-12-06T02:54:31.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35736 req_id = 0d5def34-4de4-4ec5-811a-23cb160ee2d9 roles = RoleSet { roles: {} } uri = /metrics/producers
94392024-12-06T02:54:31.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35736 req_id = 0d5def34-4de4-4ec5-811a-23cb160ee2d9 resource = Database result = Ok(()) uri = /metrics/producers
94402024-12-06T02:54:32.032ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 51153a4a-2459-4cf7-8ef8-603fcdf9d4a3
94412024-12-06T02:54:32.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40131 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35736 req_id = 0d5def34-4de4-4ec5-811a-23cb160ee2d9 response_code = 201 uri = /metrics/producers
94422024-12-06T02:54:32.101ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41479
94432024-12-06T02:54:32.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41479 req_id = f4163749-b409-43d6-b2ae-ef2e33b7d716 roles = RoleSet { roles: {} } uri = /metrics/producers
94442024-12-06T02:54:32.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41479 req_id = f4163749-b409-43d6-b2ae-ef2e33b7d716 resource = Database result = Ok(()) uri = /metrics/producers
94452024-12-06T02:54:32.135ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
94462024-12-06T02:54:32.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34530 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41479 req_id = f4163749-b409-43d6-b2ae-ef2e33b7d716 response_code = 201 uri = /metrics/producers
94472024-12-06T02:54:32.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2f2ba63b-193d-4cbd-a844-33b3a8ba37e9 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94482024-12-06T02:54:32.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2f2ba63b-193d-4cbd-a844-33b3a8ba37e9 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94492024-12-06T02:54:32.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2f2ba63b-193d-4cbd-a844-33b3a8ba37e9 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94502024-12-06T02:54:33.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3ee2e42e-09c5-4151-91cb-c0bc83e1d9a0 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94512024-12-06T02:54:33.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3ee2e42e-09c5-4151-91cb-c0bc83e1d9a0 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94522024-12-06T02:54:33.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3ee2e42e-09c5-4151-91cb-c0bc83e1d9a0 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94532024-12-06T02:54:33.638ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61738
94542024-12-06T02:54:33.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61738 req_id = 709837fb-5235-4b63-8bad-7e0b0bf243e1 roles = RoleSet { roles: {} } uri = /metrics/producers
94552024-12-06T02:54:33.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61738 req_id = 709837fb-5235-4b63-8bad-7e0b0bf243e1 resource = Database result = Ok(()) uri = /metrics/producers
94562024-12-06T02:54:33.675ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 37960cb7-3354-4d05-b7eb-4cf4f416256d
94572024-12-06T02:54:33.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37317 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61738 req_id = 709837fb-5235-4b63-8bad-7e0b0bf243e1 response_code = 201 uri = /metrics/producers
94582024-12-06T02:54:34.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2365d72f-1a47-4cc2-bcd3-8c4ada343b83 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94592024-12-06T02:54:34.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2365d72f-1a47-4cc2-bcd3-8c4ada343b83 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94602024-12-06T02:54:34.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 2365d72f-1a47-4cc2-bcd3-8c4ada343b83 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94612024-12-06T02:54:35.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = a6c7aba1-7128-4a9f-90b9-20fef6f8f4ab response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
94622024-12-06T02:54:35.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f3167fa9-e36d-4224-8bed-6d5252a017f1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94632024-12-06T02:54:35.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f3167fa9-e36d-4224-8bed-6d5252a017f1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94642024-12-06T02:54:35.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f3167fa9-e36d-4224-8bed-6d5252a017f1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94652024-12-06T02:54:36.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4761cfb7-f5bb-4ccb-97f5-1c10cde2d7be roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94662024-12-06T02:54:36.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4761cfb7-f5bb-4ccb-97f5-1c10cde2d7be resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94672024-12-06T02:54:36.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4761cfb7-f5bb-4ccb-97f5-1c10cde2d7be response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94682024-12-06T02:54:37.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 52675bb9-c88f-483d-a59a-3385cbdbb02e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94692024-12-06T02:54:37.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 52675bb9-c88f-483d-a59a-3385cbdbb02e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94702024-12-06T02:54:37.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 52675bb9-c88f-483d-a59a-3385cbdbb02e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94712024-12-06T02:54:38.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 330f0576-78e2-462d-bd6a-701de7505874 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94722024-12-06T02:54:38.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 330f0576-78e2-462d-bd6a-701de7505874 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94732024-12-06T02:54:38.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 330f0576-78e2-462d-bd6a-701de7505874 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94742024-12-06T02:54:39.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e9eb3a60-d506-48ec-9d05-7750d67deb82 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94752024-12-06T02:54:39.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e9eb3a60-d506-48ec-9d05-7750d67deb82 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94762024-12-06T02:54:39.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = e9eb3a60-d506-48ec-9d05-7750d67deb82 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94772024-12-06T02:54:40.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
94782024-12-06T02:54:40.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
94792024-12-06T02:54:40.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94802024-12-06T02:54:40.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94812024-12-06T02:54:40.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94822024-12-06T02:54:40.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94832024-12-06T02:54:40.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94842024-12-06T02:54:40.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94852024-12-06T02:54:40.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.196881ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94862024-12-06T02:54:40.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94872024-12-06T02:54:40.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94882024-12-06T02:54:40.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94892024-12-06T02:54:40.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94902024-12-06T02:54:40.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94912024-12-06T02:54:40.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94922024-12-06T02:54:40.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94932024-12-06T02:54:40.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
94942024-12-06T02:54:40.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94952024-12-06T02:54:40.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94962024-12-06T02:54:40.150ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
94972024-12-06T02:54:40.150ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.05706ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
94982024-12-06T02:54:40.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c9f2172-4b88-4994-9397-3cedc0882037 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
94992024-12-06T02:54:40.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c9f2172-4b88-4994-9397-3cedc0882037 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95002024-12-06T02:54:40.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7c9f2172-4b88-4994-9397-3cedc0882037 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95012024-12-06T02:54:41.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ad15c78b-cece-4561-a573-35f0cdf0af16 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95022024-12-06T02:54:41.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ad15c78b-cece-4561-a573-35f0cdf0af16 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95032024-12-06T02:54:41.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ad15c78b-cece-4561-a573-35f0cdf0af16 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95042024-12-06T02:54:42.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b944bb67-ab30-4c05-93c6-2c6f9f0a5e76 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95052024-12-06T02:54:42.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b944bb67-ab30-4c05-93c6-2c6f9f0a5e76 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95062024-12-06T02:54:42.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b944bb67-ab30-4c05-93c6-2c6f9f0a5e76 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95072024-12-06T02:54:43.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f71a1def-53c1-452a-b0ab-4a1e85af171a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95082024-12-06T02:54:43.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f71a1def-53c1-452a-b0ab-4a1e85af171a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95092024-12-06T02:54:43.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f71a1def-53c1-452a-b0ab-4a1e85af171a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95102024-12-06T02:54:44.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bd4bb62c-811d-466f-9501-86ae8a951938 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95112024-12-06T02:54:44.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bd4bb62c-811d-466f-9501-86ae8a951938 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95122024-12-06T02:54:44.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = bd4bb62c-811d-466f-9501-86ae8a951938 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95132024-12-06T02:54:44.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 48c9f2d3-a53a-418f-b8bf-734ee34e1557 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95142024-12-06T02:54:44.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 48c9f2d3-a53a-418f-b8bf-734ee34e1557 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95152024-12-06T02:54:44.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 48c9f2d3-a53a-418f-b8bf-734ee34e1557 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95162024-12-06T02:54:45.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 58f0d560-7a90-4ee1-9e53-4bedf68fc45a roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
95172024-12-06T02:54:45.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 58f0d560-7a90-4ee1-9e53-4bedf68fc45a resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
95182024-12-06T02:54:45.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = 58f0d560-7a90-4ee1-9e53-4bedf68fc45a response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?sort_by=id_ascending
95192024-12-06T02:54:45.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = c4651c23-b4e9-4c02-b099-d7d553311cbd roles = RoleSet { roles: {} } uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
95202024-12-06T02:54:45.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = c4651c23-b4e9-4c02-b099-d7d553311cbd resource = Database result = Ok(()) uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
95212024-12-06T02:54:45.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36852 req_id = c4651c23-b4e9-4c02-b099-d7d553311cbd response_code = 200 uri = /metrics/collectors/a3056c3a-712e-4eef-91fb-ab53fb7138ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjY2RiYTcyZC1jYmU3LTQ3ODctOTBkNC1kNTJkMzg5MjdiMjUifX0%3D
95222024-12-06T02:54:45.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1172 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 723ef6dc-baf9-4a0b-bd74-88bd5f020a4e response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
95232024-12-06T02:54:45.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b09ce02d-7d24-4525-a068-31d967cfd569 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95242024-12-06T02:54:45.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b09ce02d-7d24-4525-a068-31d967cfd569 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95252024-12-06T02:54:45.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = b09ce02d-7d24-4525-a068-31d967cfd569 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95262024-12-06T02:54:46.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f876bbc1-63ec-4d2d-a885-e0f6fe413593 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95272024-12-06T02:54:46.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f876bbc1-63ec-4d2d-a885-e0f6fe413593 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95282024-12-06T02:54:46.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f876bbc1-63ec-4d2d-a885-e0f6fe413593 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95292024-12-06T02:54:47.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 397b4aaf-b729-47bd-a302-ba67b733896a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95302024-12-06T02:54:47.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 397b4aaf-b729-47bd-a302-ba67b733896a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95312024-12-06T02:54:47.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 397b4aaf-b729-47bd-a302-ba67b733896a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95322024-12-06T02:54:48.003ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50047
95332024-12-06T02:54:48.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50047 req_id = 35eedee0-b152-4fe8-9b4a-c55f28aead31 roles = RoleSet { roles: {} } uri = /metrics/producers
95342024-12-06T02:54:48.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50047 req_id = 35eedee0-b152-4fe8-9b4a-c55f28aead31 resource = Database result = Ok(()) uri = /metrics/producers
95352024-12-06T02:54:48.014ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 2dbba7e1-9c13-427e-a69e-72040b07d167
95362024-12-06T02:54:48.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11185 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50047 req_id = 35eedee0-b152-4fe8-9b4a-c55f28aead31 response_code = 201 uri = /metrics/producers
95372024-12-06T02:54:48.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 120a001f-cd21-40d7-ab3b-d5546f8ecf5a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95382024-12-06T02:54:48.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 120a001f-cd21-40d7-ab3b-d5546f8ecf5a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95392024-12-06T02:54:48.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 120a001f-cd21-40d7-ab3b-d5546f8ecf5a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95402024-12-06T02:54:49.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3f22bc2e-0a61-469a-9eb3-392a60f02caa roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95412024-12-06T02:54:49.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3f22bc2e-0a61-469a-9eb3-392a60f02caa resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95422024-12-06T02:54:49.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3f22bc2e-0a61-469a-9eb3-392a60f02caa response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95432024-12-06T02:54:50.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
95442024-12-06T02:54:50.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95452024-12-06T02:54:50.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
95462024-12-06T02:54:50.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95472024-12-06T02:54:50.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95482024-12-06T02:54:50.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95492024-12-06T02:54:50.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95502024-12-06T02:54:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95512024-12-06T02:54:50.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95522024-12-06T02:54:50.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.185131ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95532024-12-06T02:54:50.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95542024-12-06T02:54:50.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95552024-12-06T02:54:50.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95562024-12-06T02:54:50.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95572024-12-06T02:54:50.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95582024-12-06T02:54:50.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95592024-12-06T02:54:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
95602024-12-06T02:54:50.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95612024-12-06T02:54:50.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95622024-12-06T02:54:50.119ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
95632024-12-06T02:54:50.119ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.192788ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
95642024-12-06T02:54:50.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d5a68eb-ad82-4072-b5d1-f13c6ef9cc00 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95652024-12-06T02:54:50.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d5a68eb-ad82-4072-b5d1-f13c6ef9cc00 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95662024-12-06T02:54:50.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9d5a68eb-ad82-4072-b5d1-f13c6ef9cc00 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95672024-12-06T02:54:51.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3c7bad97-85c9-4778-a3bd-d13d0819744f roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95682024-12-06T02:54:51.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3c7bad97-85c9-4778-a3bd-d13d0819744f resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95692024-12-06T02:54:51.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 3c7bad97-85c9-4778-a3bd-d13d0819744f response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95702024-12-06T02:54:53.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f6b40d8-cd75-47df-9444-ce8d29e62caf roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95712024-12-06T02:54:53.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f6b40d8-cd75-47df-9444-ce8d29e62caf resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95722024-12-06T02:54:53.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9f6b40d8-cd75-47df-9444-ce8d29e62caf response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95732024-12-06T02:54:54.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cacda37c-80c3-481e-a545-329ea1757465 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95742024-12-06T02:54:54.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cacda37c-80c3-481e-a545-329ea1757465 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95752024-12-06T02:54:54.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cacda37c-80c3-481e-a545-329ea1757465 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95762024-12-06T02:54:55.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1343 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 400c62a8-d085-44a2-b841-4d4660b3e55c response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
95772024-12-06T02:54:55.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5b7e75ac-41c8-4fcf-a0fa-2c8552a8138e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95782024-12-06T02:54:55.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5b7e75ac-41c8-4fcf-a0fa-2c8552a8138e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95792024-12-06T02:54:55.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5b7e75ac-41c8-4fcf-a0fa-2c8552a8138e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95802024-12-06T02:54:56.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 14d537f2-fc27-4769-97d1-b2031e8a5ca1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95812024-12-06T02:54:56.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 14d537f2-fc27-4769-97d1-b2031e8a5ca1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95822024-12-06T02:54:56.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 14d537f2-fc27-4769-97d1-b2031e8a5ca1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95832024-12-06T02:54:57.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c48218ed-4de5-4549-82f1-a4491bdce664 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95842024-12-06T02:54:57.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c48218ed-4de5-4549-82f1-a4491bdce664 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95852024-12-06T02:54:57.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = c48218ed-4de5-4549-82f1-a4491bdce664 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95862024-12-06T02:54:58.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57d6ec4d-d83c-47bf-b56f-4adcce2a2852 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95872024-12-06T02:54:58.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57d6ec4d-d83c-47bf-b56f-4adcce2a2852 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95882024-12-06T02:54:58.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 57d6ec4d-d83c-47bf-b56f-4adcce2a2852 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95892024-12-06T02:54:59.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93eb7a4b-8bdb-4e9b-823c-451b9215e9e6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95902024-12-06T02:54:59.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93eb7a4b-8bdb-4e9b-823c-451b9215e9e6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95912024-12-06T02:54:59.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 93eb7a4b-8bdb-4e9b-823c-451b9215e9e6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
95922024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
95932024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
95942024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95952024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
95962024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95972024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95982024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
95992024-12-06T02:55:00.101ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96002024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96012024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
96022024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96032024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
96042024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96052024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96062024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
96072024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96082024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96092024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
96102024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96112024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
96122024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96132024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
96142024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96152024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
96162024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96172024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
96182024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
96192024-12-06T02:55:00.101ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe
96202024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
96212024-12-06T02:55:00.101ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96222024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.771\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe"}
96232024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96242024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
96252024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
96262024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96272024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96282024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
96292024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96302024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
96312024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
96322024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
96332024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
96342024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96352024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
96362024-12-06T02:55:00.101ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 02:45:00.101480716 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96372024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96382024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
96392024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
96402024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96412024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96422024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
96432024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96442024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
96452024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96462024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
96472024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96482024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
96492024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96502024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
96512024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96522024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
96532024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96542024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96552024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96562024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96572024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96582024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96592024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96602024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96612024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96622024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96632024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96642024-12-06T02:55:00.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96652024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96662024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96672024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96682024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96692024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96702024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96712024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96722024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96732024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96742024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96752024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96762024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96772024-12-06T02:55:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8862fdaf-bee3-4548-a137-b8038fc2a53e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("978be6b7-c081-4ef5-81fb-d8f564b5837d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6448, tv_nsec: 470203558 } })
96782024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96792024-12-06T02:55:00.102ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f7f8b64-a9b9-4167-a80d-ed20e451d7b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d1790a0-0a7a-477f-ad45-72503586aa19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("236597f3-46af-439f-a9c6-4beaac924964.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 6448, tv_nsec: 470205238 } })
96802024-12-06T02:55:00.102ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96812024-12-06T02:55:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.515434ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96822024-12-06T02:55:00.103ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
96832024-12-06T02:55:00.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.486282ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
96842024-12-06T02:55:00.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96852024-12-06T02:55:00.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96862024-12-06T02:55:00.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96872024-12-06T02:55:00.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96882024-12-06T02:55:00.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96892024-12-06T02:55:00.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.830914ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96902024-12-06T02:55:00.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96912024-12-06T02:55:00.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96922024-12-06T02:55:00.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96932024-12-06T02:55:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96942024-12-06T02:55:00.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96952024-12-06T02:55:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96962024-12-06T02:55:00.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96972024-12-06T02:55:00.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96982024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96992024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97002024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97012024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97022024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97032024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97042024-12-06T02:55:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97052024-12-06T02:55:00.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97062024-12-06T02:55:00.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97072024-12-06T02:55:00.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97082024-12-06T02:55:00.129ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97092024-12-06T02:55:00.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97102024-12-06T02:55:00.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97112024-12-06T02:55:00.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97122024-12-06T02:55:00.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97132024-12-06T02:55:00.132ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97142024-12-06T02:55:00.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97152024-12-06T02:55:00.134ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6448, tv_nsec: 502021986 } })
97162024-12-06T02:55:00.134ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97172024-12-06T02:55:00.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97182024-12-06T02:55:00.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97192024-12-06T02:55:00.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97202024-12-06T02:55:00.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97212024-12-06T02:55:00.140ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 02:45:00.101480716 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97222024-12-06T02:55:00.140ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 39.429376ms iteration = 14 status = {"expiration":"2024-12-06T02:45:00.101480716Z","pruned":[]}
97232024-12-06T02:55:00.141ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6448, tv_nsec: 509174191 } })
97242024-12-06T02:55:00.141ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 39.879439ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
97252024-12-06T02:55:00.141ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97262024-12-06T02:55:00.150ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97272024-12-06T02:55:00.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97282024-12-06T02:55:00.155ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5455a27f-b1dd-4d8d-adde-726221dabebe.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6448, tv_nsec: 523209372 } })
97292024-12-06T02:55:00.155ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
97302024-12-06T02:55:00.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9848b0a3-cf53-493b-9755-d49ef8bcab5a roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
97312024-12-06T02:55:00.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9848b0a3-cf53-493b-9755-d49ef8bcab5a resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
97322024-12-06T02:55:00.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97332024-12-06T02:55:00.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97342024-12-06T02:55:00.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97352024-12-06T02:55:00.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97362024-12-06T02:55:00.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97372024-12-06T02:55:00.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97382024-12-06T02:55:00.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97392024-12-06T02:55:00.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97402024-12-06T02:55:00.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97412024-12-06T02:55:00.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97422024-12-06T02:55:00.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9848b0a3-cf53-493b-9755-d49ef8bcab5a response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
97432024-12-06T02:55:00.187ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97442024-12-06T02:55:00.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97452024-12-06T02:55:00.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97462024-12-06T02:55:00.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97472024-12-06T02:55:00.190ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482024-12-06T02:55:00.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97492024-12-06T02:55:00.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97502024-12-06T02:55:00.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97512024-12-06T02:55:00.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97522024-12-06T02:55:00.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97532024-12-06T02:55:00.202ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97542024-12-06T02:55:00.202ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97552024-12-06T02:55:00.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97562024-12-06T02:55:00.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97572024-12-06T02:55:00.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97582024-12-06T02:55:00.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97592024-12-06T02:55:00.211ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97602024-12-06T02:55:00.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97612024-12-06T02:55:00.216ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.704106ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97622024-12-06T02:55:00.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97632024-12-06T02:55:00.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97642024-12-06T02:55:00.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97652024-12-06T02:55:00.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.957741ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97662024-12-06T02:55:00.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97672024-12-06T02:55:00.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682024-12-06T02:55:00.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97692024-12-06T02:55:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97702024-12-06T02:55:00.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97712024-12-06T02:55:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97722024-12-06T02:55:00.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97732024-12-06T02:55:00.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97742024-12-06T02:55:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97752024-12-06T02:55:00.222ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97762024-12-06T02:55:00.222ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97772024-12-06T02:55:00.222ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 120.745639ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97782024-12-06T02:55:00.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97792024-12-06T02:55:00.229ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97802024-12-06T02:55:00.229ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97812024-12-06T02:55:00.229ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97822024-12-06T02:55:00.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97832024-12-06T02:55:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97842024-12-06T02:55:00.230ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97852024-12-06T02:55:00.230ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97862024-12-06T02:55:00.230ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 129.55582ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97872024-12-06T02:55:00.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882024-12-06T02:55:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97892024-12-06T02:55:00.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 132.509025ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
97902024-12-06T02:55:00.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97912024-12-06T02:55:00.234ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97922024-12-06T02:55:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97932024-12-06T02:55:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97942024-12-06T02:55:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97952024-12-06T02:55:00.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97962024-12-06T02:55:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97972024-12-06T02:55:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 139.566676ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
97982024-12-06T02:55:00.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97992024-12-06T02:55:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98002024-12-06T02:55:00.241ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98012024-12-06T02:55:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.74567ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98022024-12-06T02:55:00.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98032024-12-06T02:55:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98042024-12-06T02:55:00.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98052024-12-06T02:55:00.266ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98062024-12-06T02:55:00.266ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.665882ms iteration = 31 status = {"physical_disks_added":0}
98072024-12-06T02:55:00.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98082024-12-06T02:55:00.282ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98092024-12-06T02:55:00.282ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98102024-12-06T02:55:00.282ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98112024-12-06T02:55:00.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98122024-12-06T02:55:00.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98132024-12-06T02:55:00.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98142024-12-06T02:55:00.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98152024-12-06T02:55:00.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98162024-12-06T02:55:00.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98172024-12-06T02:55:00.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 191.214192ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98182024-12-06T02:55:00.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98192024-12-06T02:55:00.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98202024-12-06T02:55:00.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98212024-12-06T02:55:00.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98222024-12-06T02:55:00.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98232024-12-06T02:55:00.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 192.432077ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98242024-12-06T02:55:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
98252024-12-06T02:55:00.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98262024-12-06T02:55:00.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98272024-12-06T02:55:00.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98282024-12-06T02:55:00.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98292024-12-06T02:55:00.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98302024-12-06T02:55:00.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98312024-12-06T02:55:00.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98322024-12-06T02:55:00.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98332024-12-06T02:55:00.298ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98342024-12-06T02:55:00.298ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98352024-12-06T02:55:00.298ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98362024-12-06T02:55:00.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98372024-12-06T02:55:00.299ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98382024-12-06T02:55:00.299ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
98392024-12-06T02:55:00.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98402024-12-06T02:55:00.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98412024-12-06T02:55:00.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98422024-12-06T02:55:00.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98432024-12-06T02:55:00.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98442024-12-06T02:55:00.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98452024-12-06T02:55:00.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98462024-12-06T02:55:00.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98472024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc3220f8-f5bd-4495-8dd9-217365d841e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
98482024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98492024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 02:42:28.939281 UTC dns_group = external generation = 2
98502024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 204.996056ms iteration = 15 status = {"generation":2}
98512024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5455a27f-b1dd-4d8d-adde-726221dabebe, lookup_type: ById(5455a27f-b1dd-4d8d-adde-726221dabebe) } result = Ok(())
98522024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98532024-12-06T02:55:00.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98542024-12-06T02:55:00.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98552024-12-06T02:55:00.309ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98562024-12-06T02:55:00.309ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3ad54d0-657d-494d-9693-c77701a4807b", "content-length": "26", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
98572024-12-06T02:55:00.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98582024-12-06T02:55:00.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98592024-12-06T02:55:00.313ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
98602024-12-06T02:55:00.313ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 211.871522ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
98612024-12-06T02:55:00.330ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98622024-12-06T02:55:00.330ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98632024-12-06T02:55:00.331ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d98e43c9-83ac-4303-af00-eb3289ea384a", "content-length": "26", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
98642024-12-06T02:55:00.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98652024-12-06T02:55:00.333ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98662024-12-06T02:55:00.337ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98672024-12-06T02:55:00.337ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98682024-12-06T02:55:00.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98692024-12-06T02:55:00.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98702024-12-06T02:55:00.345ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98712024-12-06T02:55:00.345ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98722024-12-06T02:55:00.345ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 244.151184ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98732024-12-06T02:55:00.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 zone_address = fd00:1122:3344:101::2
98742024-12-06T02:55:00.348ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98752024-12-06T02:55:00.349ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8945fdd0-b382-4720-acac-4e9cc8e14685", "content-length": "26", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
98762024-12-06T02:55:00.349ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98772024-12-06T02:55:00.351ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
98782024-12-06T02:55:00.353ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T02:41:57.498140Z, time_modified: 2024-12-06T02:41:57.498140Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, db_silo: Silo { identity: SiloIdentity { id: 36adb3b8-4238-4eb5-8913-0041468585a1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T02:42:28.887030Z, time_modified: 2024-12-06T02:42:28.887030Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa" }] }) }
98792024-12-06T02:55:00.353ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 252.595215ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]}},"default_endpoint":{"silo_id":"36adb3b8-4238-4eb5-8913-0041468585a1","tls_certs":["5c4e37b91c1e76a52e9676cc40f9595dfda09def64305fee6866a2e5e67c8aaa"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98802024-12-06T02:55:00.371ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98812024-12-06T02:55:00.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 269.980022ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98822024-12-06T02:55:00.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98832024-12-06T02:55:00.510ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "49a0140c-0161-4141-94ea-2247a45abc9e", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98842024-12-06T02:55:00.510ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98852024-12-06T02:55:00.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "39358f62-5e9a-41a7-8bcf-87af967af1d5", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98862024-12-06T02:55:00.511ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98872024-12-06T02:55:00.513ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98882024-12-06T02:55:00.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 411.848854ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
98892024-12-06T02:55:00.525ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98902024-12-06T02:55:00.551ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 450.182459ms iteration = 27 status = {}
98912024-12-06T02:55:00.580ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98922024-12-06T02:55:00.580ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b73b9d40-2b92-4442-b526-7d067e28d9ff", "content-length": "691", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
98932024-12-06T02:55:00.580ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
98942024-12-06T02:55:00.580ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
98952024-12-06T02:55:00.580ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
98962024-12-06T02:55:00.583ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 482.06333ms iteration = 28 status = {}
98972024-12-06T02:55:00.613ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98982024-12-06T02:55:00.613ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98992024-12-06T02:55:00.613ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b69de67-c489-4a94-96f2-d5ec7b71aa80", "content-length": "372", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99002024-12-06T02:55:00.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99012024-12-06T02:55:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99022024-12-06T02:55:00.614ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99032024-12-06T02:55:00.614ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9bf710c-0a62-44fa-901e-65e9f6abe1bb", "content-length": "2", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99042024-12-06T02:55:00.616ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 514.811074ms iteration = 27 status = 0
99052024-12-06T02:55:00.617ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99062024-12-06T02:55:00.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99072024-12-06T02:55:00.619ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 517.896964ms iteration = 27 status = null
99082024-12-06T02:55:00.626ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99092024-12-06T02:55:00.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9ecc3388-51b6-4305-9d01-ac5061d1990f", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99102024-12-06T02:55:00.626ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99112024-12-06T02:55:00.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e45c9c01-1ff8-4fa6-8379-0311052cf88a", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99122024-12-06T02:55:00.627ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99132024-12-06T02:55:00.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "098595c7-0a08-4a5f-bd25-b2df282e11b4", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99142024-12-06T02:55:00.630ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99152024-12-06T02:55:00.632ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99162024-12-06T02:55:00.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 531.44736ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99172024-12-06T02:55:00.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99182024-12-06T02:55:00.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99192024-12-06T02:55:00.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99202024-12-06T02:55:00.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99212024-12-06T02:55:00.650ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1dafc30b-0006-4b2b-b2f6-f43f59e76a91 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99222024-12-06T02:55:00.650ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99232024-12-06T02:55:00.650ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 02:42:27.891244 UTC dns_group = internal generation = 1
99242024-12-06T02:55:00.650ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 549.024422ms iteration = 15 status = {"generation":1}
99252024-12-06T02:55:00.656ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99262024-12-06T02:55:00.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99272024-12-06T02:55:00.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e18265e8-f438-46e5-baff-103d2a320ea1", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99282024-12-06T02:55:00.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99292024-12-06T02:55:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99302024-12-06T02:55:00.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99312024-12-06T02:55:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99322024-12-06T02:55:00.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99332024-12-06T02:55:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99342024-12-06T02:55:00.665ZINFOnexus (BackgroundTasks): VPC route manager sled 5455a27f-b1dd-4d8d-adde-726221dabebe push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99352024-12-06T02:55:00.665ZDEBGnexus (BackgroundTasks): client request SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99362024-12-06T02:55:00.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99372024-12-06T02:55:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99382024-12-06T02:55:00.673ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cb8087a5-ca7f-49a2-854d-ac1eb58ca028, rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62) } rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
99392024-12-06T02:55:00.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99402024-12-06T02:55:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99412024-12-06T02:55:00.682ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99422024-12-06T02:55:00.682ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b04222ec-1952-48af-b65a-76dd4b596b59", "content-length": "134", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99432024-12-06T02:55:00.682ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99442024-12-06T02:55:00.682ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e0d80b2d-1b93-4369-aa5a-c9aa60f3fa62
99452024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99462024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99472024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99482024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99492024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99502024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99512024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99522024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99532024-12-06T02:55:00.683ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10
99542024-12-06T02:55:00.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99552024-12-06T02:55:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99562024-12-06T02:55:00.685ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99572024-12-06T02:55:00.685ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "72c969fd-b2ae-49f6-b502-01d0316d524d", "content-length": "2", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99582024-12-06T02:55:00.685ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99592024-12-06T02:55:00.685ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e24c801-430e-4dcf-bef3-accaaf64ecd2", "content-length": "52", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99602024-12-06T02:55:00.685ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch_location = Switch0
99612024-12-06T02:55:00.685ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99622024-12-06T02:55:00.757ZDEBGnexus (BackgroundTasks): client response SledAgent = 5455a27f-b1dd-4d8d-adde-726221dabebe background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2d5e6c1e-68e7-4579-8840-a7fc5300d786", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99632024-12-06T02:55:00.759ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 658.281903ms iteration = 29 status = {}
99642024-12-06T02:55:00.936ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db358137-0b28-4bf0-810e-43571ca12c89", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99652024-12-06T02:55:00.936ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 switch = Switch0
99662024-12-06T02:55:00.936ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99672024-12-06T02:55:00.936ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa39b2e1-03c3-48c1-8086-8e14b63b0d10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc9b2ad7-c40d-454a-ad8d-2311e06ca149", "content-length": "682", "date": "Fri, 06 Dec 2024 02:55:00 GMT"} })
99682024-12-06T02:55:00.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99692024-12-06T02:55:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99702024-12-06T02:55:00.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99712024-12-06T02:55:00.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99722024-12-06T02:55:00.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99732024-12-06T02:55:00.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99742024-12-06T02:55:00.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99752024-12-06T02:55:00.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99762024-12-06T02:55:00.953ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 852.467379ms iteration = 27 status = {}
99772024-12-06T02:55:01.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7d9bf1fe-156f-4a2b-bf96-5ed7f8a8be76 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99782024-12-06T02:55:01.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7d9bf1fe-156f-4a2b-bf96-5ed7f8a8be76 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99792024-12-06T02:55:01.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 7d9bf1fe-156f-4a2b-bf96-5ed7f8a8be76 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99802024-12-06T02:55:01.602ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
99812024-12-06T02:55:01.602ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
99822024-12-06T02:55:01.633ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
99832024-12-06T02:55:01.633ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:57974
99842024-12-06T02:55:01.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57974 req_id = 83cca84a-9243-401b-8b9d-22c01c0d7c39 roles = RoleSet { roles: {} } uri = /metrics/producers
99852024-12-06T02:55:01.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57974 req_id = 83cca84a-9243-401b-8b9d-22c01c0d7c39 resource = Database result = Ok(()) uri = /metrics/producers
99862024-12-06T02:55:01.669ZINFOnexus: assigned collector to new producer collector_id = a3056c3a-712e-4eef-91fb-ab53fb7138ad file = nexus/src/app/oximeter.rs:76 producer_id = 3943088e-6ce0-4ada-925c-494df92c0dda
99872024-12-06T02:55:01.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35647 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57974 req_id = 83cca84a-9243-401b-8b9d-22c01c0d7c39 response_code = 201 uri = /metrics/producers
99882024-12-06T02:55:01.669ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "83cca84a-9243-401b-8b9d-22c01c0d7c39", "content-length": "41", "date": "Fri, 06 Dec 2024 02:55:01 GMT"} })
99892024-12-06T02:55:01.670ZDEBGnexus (producer-registration-task): registered with nexus successfully
99902024-12-06T02:55:01.670ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
99912024-12-06T02:55:02.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dc548e6d-4600-44a6-8abb-9ebcb50f5ea4 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99922024-12-06T02:55:02.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dc548e6d-4600-44a6-8abb-9ebcb50f5ea4 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99932024-12-06T02:55:02.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = dc548e6d-4600-44a6-8abb-9ebcb50f5ea4 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99942024-12-06T02:55:03.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4268ab33-63e7-4500-9a15-d8c9cd005f20 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99952024-12-06T02:55:03.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4268ab33-63e7-4500-9a15-d8c9cd005f20 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99962024-12-06T02:55:03.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 4268ab33-63e7-4500-9a15-d8c9cd005f20 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99972024-12-06T02:55:04.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 09e06650-9c54-4c9c-b143-e76550125a4e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99982024-12-06T02:55:04.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 09e06650-9c54-4c9c-b143-e76550125a4e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
99992024-12-06T02:55:04.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 09e06650-9c54-4c9c-b143-e76550125a4e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100002024-12-06T02:55:05.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 3c53c844-a86e-49ca-8350-b26193fc6843 response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
100012024-12-06T02:55:05.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 89280f63-db6e-4738-b939-e5a7ef17f8b1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100022024-12-06T02:55:05.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 89280f63-db6e-4738-b939-e5a7ef17f8b1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100032024-12-06T02:55:05.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 89280f63-db6e-4738-b939-e5a7ef17f8b1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100042024-12-06T02:55:06.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ce32f6ed-5155-48f5-aed9-868cb5a8984e roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100052024-12-06T02:55:06.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ce32f6ed-5155-48f5-aed9-868cb5a8984e resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100062024-12-06T02:55:06.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ce32f6ed-5155-48f5-aed9-868cb5a8984e response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100072024-12-06T02:55:07.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a8f405fe-a54f-4285-8fa7-a5cd4d94e101 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100082024-12-06T02:55:07.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a8f405fe-a54f-4285-8fa7-a5cd4d94e101 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100092024-12-06T02:55:07.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = a8f405fe-a54f-4285-8fa7-a5cd4d94e101 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100102024-12-06T02:55:08.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a9928ca-aa0f-420b-8019-8a9e71a93e26 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100112024-12-06T02:55:08.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a9928ca-aa0f-420b-8019-8a9e71a93e26 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100122024-12-06T02:55:08.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 6a9928ca-aa0f-420b-8019-8a9e71a93e26 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100132024-12-06T02:55:09.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5924053c-123a-480b-95e2-e2d7632db4ee roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100142024-12-06T02:55:09.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5924053c-123a-480b-95e2-e2d7632db4ee resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100152024-12-06T02:55:09.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 5924053c-123a-480b-95e2-e2d7632db4ee response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100162024-12-06T02:55:10.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
100172024-12-06T02:55:10.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
100182024-12-06T02:55:10.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100192024-12-06T02:55:10.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100202024-12-06T02:55:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100212024-12-06T02:55:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100222024-12-06T02:55:10.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100232024-12-06T02:55:10.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100242024-12-06T02:55:10.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100252024-12-06T02:55:10.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100262024-12-06T02:55:10.135ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100272024-12-06T02:55:10.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100282024-12-06T02:55:10.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100292024-12-06T02:55:10.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100302024-12-06T02:55:10.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.703242ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100312024-12-06T02:55:10.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100322024-12-06T02:55:10.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
100332024-12-06T02:55:10.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100342024-12-06T02:55:10.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100352024-12-06T02:55:10.180ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
100362024-12-06T02:55:10.180ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.987815ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
100372024-12-06T02:55:10.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 38060148-b56a-4c08-a94d-9de5f54cfff6 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100382024-12-06T02:55:10.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 38060148-b56a-4c08-a94d-9de5f54cfff6 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100392024-12-06T02:55:10.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 38060148-b56a-4c08-a94d-9de5f54cfff6 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100402024-12-06T02:55:11.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 254b91bc-1d89-4d37-a2b6-6dbbfecdc796 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100412024-12-06T02:55:11.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 254b91bc-1d89-4d37-a2b6-6dbbfecdc796 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100422024-12-06T02:55:11.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 254b91bc-1d89-4d37-a2b6-6dbbfecdc796 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100432024-12-06T02:55:12.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9b7f5068-8eae-468a-9c44-e0bc7583595c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100442024-12-06T02:55:12.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9b7f5068-8eae-468a-9c44-e0bc7583595c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100452024-12-06T02:55:12.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9b7f5068-8eae-468a-9c44-e0bc7583595c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100462024-12-06T02:55:13.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cab3ea8c-b709-4fd5-a131-ea508cdcda50 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100472024-12-06T02:55:13.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cab3ea8c-b709-4fd5-a131-ea508cdcda50 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100482024-12-06T02:55:13.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = cab3ea8c-b709-4fd5-a131-ea508cdcda50 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100492024-12-06T02:55:14.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 483c6e96-bd0d-4917-af40-b5538071cd70 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100502024-12-06T02:55:14.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 483c6e96-bd0d-4917-af40-b5538071cd70 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100512024-12-06T02:55:14.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 483c6e96-bd0d-4917-af40-b5538071cd70 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100522024-12-06T02:55:15.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 9a30200a-aa98-4424-ab97-513e8f6183ad roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
100532024-12-06T02:55:15.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 9a30200a-aa98-4424-ab97-513e8f6183ad resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
100542024-12-06T02:55:15.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59089 req_id = 9a30200a-aa98-4424-ab97-513e8f6183ad response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
100552024-12-06T02:55:15.026ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 361b5e29-90ca-48d7-9636-689a399604de response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
100562024-12-06T02:55:15.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9eb6d3af-4c3a-4586-8dab-0b74022d6b75 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100572024-12-06T02:55:15.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9eb6d3af-4c3a-4586-8dab-0b74022d6b75 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100582024-12-06T02:55:15.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 9eb6d3af-4c3a-4586-8dab-0b74022d6b75 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100592024-12-06T02:55:16.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb0beb50-8568-49ee-86d4-8765703bf3c1 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100602024-12-06T02:55:16.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb0beb50-8568-49ee-86d4-8765703bf3c1 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100612024-12-06T02:55:16.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = fb0beb50-8568-49ee-86d4-8765703bf3c1 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100622024-12-06T02:55:17.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 365a7095-f96e-46b0-a2c7-090acbd426ce roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100632024-12-06T02:55:17.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 365a7095-f96e-46b0-a2c7-090acbd426ce resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100642024-12-06T02:55:17.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 365a7095-f96e-46b0-a2c7-090acbd426ce response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100652024-12-06T02:55:18.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aad44a09-b895-4340-b543-a64d0d6ed8f5 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100662024-12-06T02:55:18.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aad44a09-b895-4340-b543-a64d0d6ed8f5 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100672024-12-06T02:55:18.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = aad44a09-b895-4340-b543-a64d0d6ed8f5 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100682024-12-06T02:55:19.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0af169f8-df1d-4967-98a9-398ee815e240 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100692024-12-06T02:55:19.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0af169f8-df1d-4967-98a9-398ee815e240 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100702024-12-06T02:55:19.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0af169f8-df1d-4967-98a9-398ee815e240 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100712024-12-06T02:55:20.100ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
100722024-12-06T02:55:20.100ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
100732024-12-06T02:55:20.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100742024-12-06T02:55:20.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100752024-12-06T02:55:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100762024-12-06T02:55:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100772024-12-06T02:55:20.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100782024-12-06T02:55:20.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100792024-12-06T02:55:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100802024-12-06T02:55:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100812024-12-06T02:55:20.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100822024-12-06T02:55:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100832024-12-06T02:55:20.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100842024-12-06T02:55:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100852024-12-06T02:55:20.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100862024-12-06T02:55:20.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 32c3bdce-1c7e-4465-b23a-2943980ebcbe, lookup_type: ById(32c3bdce-1c7e-4465-b23a-2943980ebcbe) } result = Ok(())
100872024-12-06T02:55:20.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100882024-12-06T02:55:20.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100892024-12-06T02:55:20.121ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe original_time_created = 2024-12-06 02:41:51.661354 UTC target_id = 32c3bdce-1c7e-4465-b23a-2943980ebcbe time_created = 2024-12-06 02:41:51.661354 UTC
100902024-12-06T02:55:20.121ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.68433ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"32c3bdce-1c7e-4465-b23a-2943980ebcbe","time_created":"2024-12-06T02:41:51.661354Z"}
100912024-12-06T02:55:20.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.054859ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100922024-12-06T02:55:20.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f9eb8152-0b28-4b7a-becb-a51aad9dd965 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100932024-12-06T02:55:20.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f9eb8152-0b28-4b7a-becb-a51aad9dd965 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100942024-12-06T02:55:20.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = f9eb8152-0b28-4b7a-becb-a51aad9dd965 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100952024-12-06T02:55:21.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 215be63c-ddf1-4639-b928-14d2af7b086c roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100962024-12-06T02:55:21.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 215be63c-ddf1-4639-b928-14d2af7b086c resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100972024-12-06T02:55:21.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 215be63c-ddf1-4639-b928-14d2af7b086c response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100982024-12-06T02:55:22.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 790f874e-181b-4764-a6f9-d36e54d3e929 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
100992024-12-06T02:55:22.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 790f874e-181b-4764-a6f9-d36e54d3e929 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101002024-12-06T02:55:22.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 790f874e-181b-4764-a6f9-d36e54d3e929 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101012024-12-06T02:55:23.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae2c96ff-dc44-4998-8101-c2bbb4ba2ca2 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101022024-12-06T02:55:23.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae2c96ff-dc44-4998-8101-c2bbb4ba2ca2 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101032024-12-06T02:55:23.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = ae2c96ff-dc44-4998-8101-c2bbb4ba2ca2 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101042024-12-06T02:55:24.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 890c3481-a14c-4dac-b22f-9ca9d875c0ef roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101052024-12-06T02:55:24.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 890c3481-a14c-4dac-b22f-9ca9d875c0ef resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101062024-12-06T02:55:24.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 890c3481-a14c-4dac-b22f-9ca9d875c0ef response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101072024-12-06T02:55:25.025ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1410 local_addr = [fd00:1122:3344:101::b]:55607 method = GET remote_addr = [fd00:1122:3344:101::d]:56731 req_id = 0ea988e0-adc0-41d0-a47a-85b2c738feef response_code = 200 uri = /3943088e-6ce0-4ada-925c-494df92c0dda
101082024-12-06T02:55:25.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e049cf0-faf9-4740-b077-605d15adc136 roles = RoleSet { roles: {} } uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101092024-12-06T02:55:25.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e049cf0-faf9-4740-b077-605d15adc136 resource = Database result = Ok(()) uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe
101102024-12-06T02:55:25.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 0e049cf0-faf9-4740-b077-605d15adc136 response_code = 200 uri = /probes/5455a27f-b1dd-4d8d-adde-726221dabebe